United States Patent ti9] 

Wang 



illlill 



US005113445A 

[H] Patent Number: 
[45] Date of Patent: 



5,113,445 
May 12, 1992 



[54] 

[75] 

[73] 

[21] 
[22] 



SYSTEM FOR ENCODING DATA IN 
MACHINE READABLE GRAPHIC FORM 



Inventor: 

Assignee: 

Appl. No.; 
Filed: 



Yi^iun P. Wang, Port Jefferson 
Station, N.Y, 

Symbol Technologies Inc., Bohemia, 
N.Y. 

653,822 

Feb. 11, 1991 



Related U.S. Application Data 

[63] Coniinuation of Ser. No. 550,023, Jul. 9, 1990, aban- 
doned. 

[51] Int. CV H04L9/00 

[52] U.S. CI 380/51; 235/462 

[58] Field of Search 380/55, 51, 3, 59; 

235/462 

[56] References Cited 

U.S. PATENT DOCUMENTS 

3,647,275 3/1972 Ward 283/70 

3,676,644 7/1972 Vaccaro et al 235/449 

3,761,683 9/1973 Rogers 235/380 

3.812.328 5/1974 Tramposch 235/487 

4,654,718 3/1987 Sueyoshi . 

4,654,793 3/1987 Elrod 235/380 - 

4,660.221 4/1987 Dlugos 380/23 

4,794,239 12/1988 Allais 235/462 



4.835,713 5/1989 Pastor 380/51 

4,863,196 9/1989 Ohnishi el al 283/82 

4,893,333 1/1990 Baran ct al. . 

4,908.873 3/1990 Philibert ct al. . 

4,949,381 8/1990 Pastor 380/51 

4.975,948 12/1990 Andresen ct al. . 

FOREIGN PATIENT DOCUMENTS 

59-44157 3/1984 Japan . 
62-91075 4/1991 Japan . 

Primary Exam //ler— Thomas H. Tarcia 
Assistant Examiner— David Cain 

[57] ABSTRACT 

A system for representing and recognizing data in ma- 
chine readable graphic image form in which data to be 
encoded is entered into the system and a processor 
encodes the data into a two-dimensional pattern of 
graphic indicia and generates transfer drive signals rep- 
resentative of the indicia. A transferring device such as 
a printer transfers an image of the two-dimensional 
pattern of graphic indicia onto a carrier such as a card 
or paper document in responsde to the transfer drive 
signals. A recognition device converts the image on the 
carrier into electrical signals representative of the 
graphic indicia and decodes the signals into output sig- 
nals representative of the data for further processing or 
use. 

27 Claims, 3 Drawing Sheets 
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SYSTEM FOR ENCODING DATA IN MACHINE 
READABLE GRAPHIC FORM 

This is a continuation of application Ser. No. 550,023 5 
filed July 9, 1990 now abandoned. 

REFERENCE TO RELATED APPLICATIONS 

The present application is related to U.S. patent appli- 
cation Ser. No. .461,881 assigned to the same assignee as 10 
the present application. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention generally relates to the repre- 15 
sentation of data in machine readable form and more 
particularly to a system for the encryption of data into 
a two-dimensional graphic image that can be automati- 
cally machine read to obtain the encoded data in both 
open and closed systems. 20 

2. Description of the Prior Art 

In todays high technology world more and more 
operations are being automatically performed by ma- 
chines and systems. This ever-increasing drive for auto- 
mation has resulted in a demand for new techniques for 25 
encoding data into machine readable form for automatic 
entry into the various systems and machinery. The data 
entry may be for such uses as data transmission, operat- 
ing various machine functions or the identification of 
persons or items. The various media that carry the data 30 
for automatic entry include punch cards, magnetic tapes 
and discs and magnetic stripes on cards such as Credit 
Cards and badges. The systems utilizing the above car- 
riers are in "closed" systems, i.e. the read function is 
performed within an apparatus or housing and the read- 35 
ing element is in contact or in near-contact with the 
Carrier means during the reading operation. 

One method for representing data in a machine read- 
able form is to encode the data into a pattern of indicia 
having parts of different light reflectivity, for example, 40 
ar code symbols. A bar code symbol is a pattern com- 
prised of a series of bars of various widths and spaced 
apart from one another by spaces of various widths, the 
bars and spaces having different light reflective proper- 
ties. The bar code symbol is optically scanned and the 45 
resulting electrical signals are decoded into data repre- 
sentative ofthe symbol for further processing. Bar code 
reading systems are known as "open" systems in that 
the carrier while being read is not sealed, but is read 
from a distance and without being in physical contact 50 
with the scanner. 

The conventional bar code described above is "one- 
dimensional'* in that the information encoded therein is 
represented by the width of the bars and spaces, which 
extend in a single dimension. Similarly data encoded 55 
onto other media such as credit card magnetic stripes is 
composed of one or more "one-dimensional** tracks of 
encoded data. 

The use of bar code symbols and magnetically en- 
coded data has found wide acceptance in almost every 60 
type of industry. However, the one dimensional nature 
of the encoded data limits the amount of information 
that can be encoded and hence use has been generally 
restricted to simple digital representations. 

Thus, there is a need for a system to encode data in 65 
machine readable form that allows for an increase in the 
amount of data encoded into a given space that can be 
quickly and easily decoded for further processing. 



SUMMARY OF THE INVENTION 

The present invention is directed to a system for 
representing and recognizing data in machine readable 
graphic image form having an increased capacity for 
encoded information that can be used in both open and 
closed systems. The system comprises an encoding 
means having a means for entering data such as a key- 
board or optical character scanner. In addition, the data 
may be obtained directly from computer files. The data 
entered into the system may be both textual data and 
control data. The data is entered into a processing 
means for encoding the data into a two-dimensional 
pattern of graphic indicia. The graphic indicia may, for 
example, be in the form of a two-dimensional bar code 
which is comprised of a pattern of vertical bars of pre- 
determined lengths that are spaced at various vertical 
and horizontal intervals. It should be understood that 
the graphic indicia representative of the data is not 
limited to a bar code symbol type, but may be in the 
form of any two-dimensional graphic pattern of indicia 
suitable for encoding data. 

The processing means generates electrical drive sig- 
nals for transferring the two-dimensional graphic pat- 
tern onto, a data Carrier means, that may be a card or 
document or the surface of a machine part. The encod- 
ing means also includes means for transferring an image 
of the two-dimensional pattern of graphic indicia onto 
the data carrier means in response to the transfer drive 
signals. 

The image may for example be primed in the form of 
a two-dimensional pattern of graphic indicia having 
different areas of light reflectivity in which the indicia 
have one level of reflectivity and the spaces have an- 
other level of reflectivity. In this embodiment, the con- 
verting means may be a type of optical scanner typically 
used for scanning one-dimensional bar codes that Con- 
verts the areas of different light reflectivity into electri- 
cal signals representative of the indicia. Scanners em- 
ployed in the present invention, however, have the 
added feature of scanning the indicia in two dimensions. 
For example, in one method a laser light beam is scan- 
ner across the indicia in a raster pattern for reading and 
decoding two-dimensional graphic codes. Optical scan- 
ners suitable for reading two-dimensional patterns are 
disclosed in U.S. patent application Ser. Nos. 317,433 
and 317,533, filed Mar. 1, 1989, assigned to the same 
assignee as the present invention and incorporated 
herein by reference. 

The system of the present invention further includes 
a recognition means comprising means for converting 
the innage on the carrier means into electrical signals 
representative of the graphic indicia and means for 
decoding the electrical signals into output signals repre- 
sentative of the data. 

The decoded output signals are available for further 
processing and the system may therefore include means 
for outputting the decoder output signals. Typical out- 
put devices may include a liquid crystal display, a CRT 
display and a printer, The outputtcd signals may also be 
transmitted to a computer or other system for further 
processing and use via telephone lines using a modem or 
via a data bus. 

The present invention contemplates the outputting of 
the decoder output signals to a microprocessor for con- 
trolling the operation of various machines such as fac- . 
simile, VCR, microwave oven, robotic systems and 
weight/price label scale devices. 
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In another embodiment of the invention, the process- 
ing means encodes a first set of data into the two-dimen- 
sional pattern of graphic indicia and generates first 
transfer drive signals for transferring the two-dimen- 
sional pattern onto a carrier means. The processing 
means also generates a second set of transfer drive sig- 
nals in response to a second set of data entered into the 
system intended to be transferred to the carrier means in 
human readable form. Thereafter, the transfer means 
transfers onto the earner means both the image of the 
two-dimensional graphic pattern of indicia in response 
to the first transfer drive signals and the second set of 
data in human readable form in response to the second 
transfer drive signals. Thus, the system provides means 
for automatically representing data in both a machine 
readable form and human readable form onto a single 
carrier means. 

In yet another embodiment of the invention, the data 
is encoded and decoded using a keyed data encryption 
technique in order to increase the security of the data 
transmission. In this embodiment, only the person hav- 
ing the encryption key will be able to decode the 
graphic pattern. 

The system of the present invention maximizes the 
use of available space for encrypting data. In addition to 25 
being compact in size, the system provides for high 
security in the transmission of information. Thus, the 
invention provides a highly reliable system for re- 
presentating data in machine readable graphic form 
having increased encoding capacity thereby substan- 
tially expanding applications for automatic data entry. 
In addition, the invention creates a new media for man- 
machine interfacing. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of the system of the present 
invention. 

FIG. 2 is a perspective view of an encoding means of 
the system of the present invention, 



10 



IS 



20 



The data entered by entering means 22 may be both the 
data to be encoded into the two-dimensional pattern of 
graphic indicia and the data to appear on carrier means 
16 in human readable form. Processing means 24 en- 
codes the set of data to appear in pattern 18 into a two- 
dimensional pattern of graphic indicia and generates 
transfer drive signals for controlling the transfer of the 
indicia onto the carrier means 16. Transferring means 26 
transfers an image of the two-dimensional pattern of 
graphic indicia onto carrier means 16 in response to the 
transfer drive signals. If human readable data is also to 
be transferred onto carrier 16. the processing means 24 
generates a second set of transfer drive signals for con- 
trolling the transfer of the human readable data onto 
carrier 16. A ponion or all of the data to be encoded and 
the human readable data may be transferred from a 
storage memory in processing means 24 or other com- 
puter files rather than being entered by means 22. 

The carrier means 16 is shown in FIGS. 1, 2 and 3 is 
represented as being in the form of a card approxi- 
mately the size of a credit card. This type of card is 
illustrative only as the carrier means 18 may be made of 
any material on which graphic indicia may be trans- 
ferred to, such as paper, etc. 

Recognition means 14 includes converting means 28 
that converts the image on carrier means 16 into electri- 
cal signals representative of the graphic indicia. Decod- 
ing means 30 decodes the electrical signals into decoder 
output signals indicated at 32 that are representative of 
the data encoded into the pattern 18, 

FIG. 2 is a perspective view of one embodiment of 
encoding means 12. In this embodiment, the entering 
means 22 of FIG. 1 is shown in form of a keyboard 32 
for entering alphanumeric and graphic data into the 
35 decoding means 12. The embodiment of FIG, 2 is illus- 
trative only as entering means 22 may take forms other 
than a keyboard such as an optical scanning means for 
scanning data directly from documents for entry into 
the encoding means 12. Entering means 22 may also be 
FIG, 3 is a perspective view of a recognition means of 40 in the form of various card readers in which magneti- 



30 



the system of the present invention. 

FIG. 4 is a perspective view of a data entry device 
and a reader in which a key may be entered for encrypt- 
ing and decrypting data. 

FIG, 5 is a perspective vieNv of a facsimile machine 45 
incorporating the recognition means of the present in- 
vention. 

FIG. 6 is a representation of an embodiment of a two 
dimensional bar code as the term is used in this patent 
specification. 50 

DETAILED DESCRIPTION OF THE 
INVENTION 

Referring now to the drawings, FIG. 1 is a block 
diagram of the system 10 of the present invention for 55 
representing and recognizing data in machine readable 
graphic image form. System 10 includes an encoding 
means generally indicated by the reference numeral 12 
and a recognition means generally indicated by the 



cally encoded information is scanned and converted 
into electrical signals representative of the data. 

Referring again to FIG. 2, the processing means 24 of 
FIG. 1 is shown in the form of a processor and display 
unit 34. The data entered by keyboard 32 is transmitted 
to the processor and display unit 34 for storage and 
processing. In addition to entering data, the keyboard 
32 is also used for entering control commands to effect 
operation of the processor unit 34. 

The data entered by keyboard 32 is displayed on 
display screen 36 and upon entry of a proper control 
command, is also stored in memory. The data to be 
encoded into the pattern of graphic indicia is stored in a 
first memory, in processor 34 and the data, if any, to be 
transferred in human readable form is stored in a second 
memory. Alternatively, the data may be stored in a 
separate portion of a single memory. Upon the appro- 
priate control command from keyboard 32, the proces- 
sor unit 34 encodes the data in the first memory into a 



reference numeral 14. Encoding means 12 produces a 60 two-dimensional pattern of graphic indicia and gener- 



carrief means 16 containing at least a two-dimensional 
pattern of graphic indicia 18. Carrier means 16 may also 
contain human readable data 20. The two-dimensional 
pattern of graphic indicia on carrier means 16 is recog- 
nized by recognition means 14 to produce output signals 65 
representative of the data encoded into the pattern 18. 

Data to be transferred onto carrier means 16 is en- 
tered by entering means 22 into the encoding means 12. 



ates first transfer drive signals representative of the data 
stored in the first memory. The processor unit 34 also 
generates second transfer drive signals representative of 
the data stored in the second memory. 

The processor unit 34 is shown in FIG. 2 as being 
coupled to a printer 38. The printer 38 is one form of the 
transferring means 26 of FIG. 1. Printer 38 transifers an 
image of the two-dimensional pattern of graphic indicia 
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on carrier means 18 in response to the first transfer drive . of security may be provided with the keyed encryption 

signals and prints the second set of data in human read- embodiment. 

able form onto carrier means 18 in response to the sec- In addition, the recognition unit 40 may also transmit 
ond transfer drive signals. In one embodiment, the the output signals to a central processing unit locally or 
printer 38 prints the two-dimensional pattern in the 5 remotely, by for example a modem, for further use or 
form of graphic indicia having different areas of light processing by the CPU, In this embodiment, the data 
reflectivity, such as a two-dimensional bar code. Printer. ' encoded onto the carrier means 18 may be control data 
38 may take other forms such as a means for printing the in the form of machine operating instructions for con- 
two-dimensional pattern of graphic indicia with mag-. trolling a robotic system or to a security identification 
netic-ink. In such a device, magnetic indicia are depos- 10 system for performing such functions as unlocking 
ited on the carrier material in a two-dimensional pattern doors. In connection with the use of the present inven- 
that may be recognized by magnetic-ink recognition tion in a robotic system, it is contemplated that the 
sensors, two-dimensional graphic pattern containing the Control 

Turning now to FIG. 3, the recognition means 14 data be placed or printed directly onto a machine part 
includes a card reader 40 which contains the converting 15 or part holder. A scanner coupled to the machine tool 
means 28 and the decoding means 30 of FIG. 1. The reads the pattern and transmits the decoded instruction 
converting means 28 may be a bar code reader such as to the control computer which in turn controls the 
those disclosed in U.S. patent application Ser. Nos. machining of the part in accordance with the control 
317,433 and 317,533, assigned to the same assignee as program. Another example of the use of the present 
the present invention and incorporated herein by refer- 20 invention includes a microwave food container where 
ence. The readers disclosed in the above patent applica- the two-dimensional graphic pattern contains instruc- 
tions are open system devices designed to read an opti- tions automatically entering the recommended cooking 
call y encoded two-dimensional bar code and to convert sequence. A further use may be in connection with 
the light reflected from the pattern into electrical sig- placing on roadway signs two-dimensional patterns 
nals representative of the graphic indicia. 25 containing geographic location information that may be 

The card reader 40 may also comprise a magnetic-ink read by a scanner in passing vehicles for use with on- 

recognition device for reading and decoding magneii- board computers. 

cally encoded data. These closed system devices in- The present invention further contemplates the use of 

elude a magnetic read head that senses the change in the system of the present invention to encode control 

reluctance associated with the presence of the magnet- 30 data containing machine operating instructions onto the 

ic-ink. The use of appropriate converting means that carrier means in the form of machine readable graphic 

corresponds to the particular data encoding technology indicia that may be inserted into the niachine to effect 

employed is contemplated by the present invention. operation of the machine, FIG. 5 is an example of a 

The decoding means 30 decodes the electrical signals facsimile machine 50 in which a document 52 contain- 

into output signals representative of the data encoded 35 ing human readable data 54 and a two-dimensional pat- 

onto carrier means 18, The decoder output signals arc tern of graphic machine readable indicia 56, The docu- 

outputied from the recognition unit 40 to various output ment 52 is insened into the facsimile machine 50 the 

means 42. FIG. 3 depicts two examples of output de- same as documents are normally inserted for transmis- 

yicesi one being a display unit 44 and the other a printer sion. The machine 50 contains a converting means for 

46. Display unit 44 may be any suitable display such as 40 converting the two-dimensional image into electrical 

liquid crystal display or a CRT. The printer 46 may be signals and a decoding means for decoding the signals 

any print device such as a dot matrix printer, laser into output signals operative to actuate the facsimile 

printer, etc. machine 50. The pattern 56 may contain such informa- 

The system of the present invention maximizes the tion as the phone number of the intended recipient of 
use of available space for encrypting data. The density 45 the memo 54 and the appropriate instructions for auio- 
of the encoded data is such that for a two-dimensional matically entering the phone nuniber and actuating the 
bar code symbol, a minimum of about 1600 characters transmission process. Thus, where numerous messages 
can be encoded into a space of approximately 5" Xj'Mn are faxed to a particular recipient a supply of paper 
addition to being compact in size, the system provides containing the phone number of the recipient encoded 
for high security in the transmission of information. For 50 in the two-dimensional graphic indicia machine read- 
example, a sensitive message may be encoded onto a able format may be maintained by the sender. The trans- 
document also containing non-sensitive material. This mission of messages to that recipient will be facilitated 
document, the same as any document, can be copied, by placing the message onto the pre-encoded paper and 
transmitted by facsimile, etc., but only those with a simply inserting the paper into the facsimile machine. In 
recognition means of the present invention will be able 55 addition to simplifying and speeding the transmission 
to "read" the sensitive portion. The carrier means, process, the possibility of sending highly sensitive infor- 
being a single sheet of paper or a plastic credit card type mation to an incorrect party will also be eliminated, 
of card, is an inexpensive read-only-memory structure FIG. 6 is a representation of an embodiment of a two 
that facilitates data communication. dimensional bar code as the term is used in this patent 

In another embodiment, the data may be encoded 60 specification. Such a bar code, taken from AUais, U.S. 

using a keyed encryption algorithm that may be ac- Pat. No. 4,794,239, includes a plurality of ordered rows 

cessed only by an encryption key. As shown in FIG. 4, of codewords of bar code information, one row adja- 

the data entry means 47 contains the keyed algorithm cent to and beneath another row, each codeword repre- 

and upon entry of the key 49, the data will be encoded senting at least one information bearing character, 

into a two-dimensional graphic pattern in a unique con- 65 While the invention has been particulariy shown and 

figuration. The unique configuration can only be read described with respect to preferred embodiments 

by a reader 48 having the algorithm and only upon thereof, it will be understood by those skilled in the art 

entry of the key 49 into the reader. Thus, a high degree that the foregoing and other changes in form and detail 
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may be made therein without departing from the spirit ing means includes signal means for transferring the 

and scope of the invention which should be limited only two-dimensional bar code structure and the second set 

by the scope of the appended claims. of data in human readable form onto the portable car- 

What is claimed is: rier. 

1. A system for representing and recognizing data on 5 15. A method for representing and recognizing data 
a record carrier in the form of a machine readable two- on a record carrier in the form of a machine readable 
dimensional bar code structure comprising: two-dimensional bar code structure comprising the 

(a) encoding means including: step$ of: 

(i) means for entering data in said encoding means: (i) entering said data into an encoding station; 

(ii) processing means for encoding said data into a 10 (\\) encoding said data into a two-dimensional bar 
two-dimensional bar code structurCt said bar code structure, said bar code structure including a 
code structure including a plurality of ordered, plurality of ordered, adjacent rows of codewords 
adjacent rows of codewords of bar-coded infor- of bar<oded information, each of said codewords 
mat ion, each of said codewords representing at representing at least one information-bearing char* 
least one information-bearing character, and for IS acter; 

generating first transfer drive signals; (iii) transferring an image of the two-dimensional bar 

(iii) means for transferring an image of the two-di- code structure onto a portable record carrier; 
mcnsional bar code structure onto a portable (iv) scanning the image of the two-dimensional bar 
record carrier in response to said first transfer code structure in a separate decoding station and 
drive signals; and 20 converting the codewords into electrical signals 

(b) recognition means including: representative of the information-bearing charac- 
(j) means for scanning the image of the two-dimen- ters; and 

sional bar code structure and for converting the (v) decoding the electrical signals into output signals 

codewords into electrical signals representative representing said data. 

of the information -bearing characters; and 25 16. The method of claim 15 wherein said entering 
(ii) means for decoding the electrical signals into step includes the substep of entering said data on a key- 
output signals representative of said data. board. 

2. The system of claim 1 wherein said recognition 17. The method of claim 15 wherein said entering 
means includes an output device for displaying said data step includes the substep of scanning said data from a 
in human readable fonn. 30 sheet. 

3. The system of claim 2 wherein said output device 18. The method of claim 15 wherein said transferring 
is a liquid crystal display. step includes the substep of printing the image onto the 

4. The system of claim 2 wherein said output device carrier. 

is a CRT display. 19. The method of claim 15 further comprising the 

5. The system of claim 2 wherein said output device 35 step' of displaying the data in human readable form. 

is a printer. 20. The method of claim 19 wherein said displaying 

6. The system of claim 1 wherein said recognition step includes the substep of displaying the data on a 
means includes means for transmitting the decoder out- CRT display. 

put signals to a computer. 21. The method of claim 19 wherein said displaying 

7. The system of claim 6 wherein said transmitting 40 step includes the substep of displaying the data on a 
means includes a modem. liquid crystal display. 

8. The system of claim 1 wherein said recognition 22. The method of claim 19 wherein said displaying 
means includes means for transmitting the decoder out- step includes the substep of printing the data on a 
put signals to a microprocessor. printer. 

9. The system of claim 8 wherein the microprocessor 45 23. The method of claim IS further comprising the 
controls the operation of one of a facsimile machine, a step of transmitting the output signals to a computer. 
VCR, a microwave oven, a robot and a weight/price 24. The method of claim 23 wherein said transmitting 
label scale, in response to said decoder output signals. step includes the substep of transmitting the output 

lb. The system of claim 11 wherein said entering signals to the computer by a modem, 

means includes a keyboard for entering said data. SO 25. The method of claim 15 further comprising the 

11. The system of claim 1 wherdn said entering step of transmitting the output signals to a microproces- 
means includes means for scanning data from a sheet. sor. 

12. The system of claim U wherein said processing 26. The method of claim 25 further comprising the 
means includes means for generating second transfer step of controlling the operation of one of a facsimile 
drive signals in response to a second set of data, and 55 machine, a VCR, a microwave oven, a robot and a 
wherein said transferring means includes reading means weight/price label scale, in response to the output sig- 
for transferring onto said carrier means both the image nals. 

of the two-dimensional bar code structure in response to . 27. The method of claim 15 further comprising the 

the Hrst transfer drive signals and said second set of data steps of 

in human readable form in response to said second 60 entering a second set of data into the encoding sta- 

transfer drive signals. tion; and 

13. The system of claim 1 wherein the transferring transferring onto the portable record carrier both the 
means is a printer. image of the two-dimensional bar code structure 

14. The system of claim 12 wherein said portable and said second set of data in human readable form, 
record carrier is a single carrier, and wherein said read- 65 • ♦ ♦ • • 
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^^^^^^■^ digital data is placed onto plain paper with a digital 

^™^n.^n^^^ photocopier. The present Mention also providS a 

UAIA UINXO PLAIN PAPER method and apparatus for encrypting digital data such 

HELD OF THE INVENTION 5 ^er^^' "^^^ ^^^^ '""^^^ 

This invention relates to the field of digital communi- otixxi^ca^x, r^T^^r^ .^r. 

cations; particularly, the present invention relates to SUMMARY OF THE INVENTION 

digital communications on plain paper. A method and apparatus for transferring digital tnfor- 

BACKGROUND OF THE INVENTION 10 ^^^"^ P^P^' described. The pres- 

entmventionmvolves storing data mat least one box on 

Today, the most common practice of recording and plain paper. Each box includes a frame or border. Bi- 

transfemng mformation is through the use of plain nary data is formatted in rows within the box, wherein 

paper. One of the most widely recognized metiiods of a bit of digital data is depicted by the presence or ab- 

ra:ordmgmfonnauon on plain paper is through the use senceofan ink dot The inside edges of the left and right 

^v^ wS't^'^^n^^^ ^ "^g%P°^- sides of the box have markers for identifying the ve^. 

Sr^^n^^hlT. P"!f ^"^fi "^e^ "^f cal separations (i.e., the rows) between theSgital data, 

r^roduces the scanned miage onto a piece of phun cmhoknU the method and apparatus com- 

UntU recentiy, prior art copiers mainly operated Pf^*" reproduction system having an encryption de- 
using analog signals. In other words, the operations of 20 performing encryption on a dau source to 
scanning the image, processing the image and then re. P™^^^ encrypted data. The present invention also 
producing the image were all performed in analog Y^^^^^^ ^ encoder for encoding the encrypted data 
More recently, many functions of the copier have been ^ P"®^ values. These pixel values are then 
performed in the digital arena. However, in either the ?^tP^t }>y a printing device, such that the data is placed 
analog or digital case, tiie function of the photocopier 25 in multiple boxes having a frame and a plurality of rows 
remains the reproduction of an original image onto a columns on a piece of plain paper, such that the data 
piece of plain paper, source is represented in encrypted digitized form on the 

The change from analog-to-digital signals in photo- paper, 
copiers aUows several new operations to be performed. ^ present invention, the reproduction system also 
One new operation that may be performed is the en- 30 includes a method and apparatus for recognizing the 
cryption of information. Encryption is a technique data on the plain paper, Tlie method and apparatus for 
whereby data may be stored in a format such that the recognizing the data includes a scanning device for 
data cannot be deciphered easily. In other words, en- scanning the boxes on the plain paper and for convert- 
cryption provides a mechanism for encoding data. ing the pixels into electrical signals representative of the 
There are numerous techniques in the prior art for en- 35 characters. The present invention also includes a de- 
cryption However, all of these prior art techniques coder for decoding the electrical signak into output 
require tiiat the data be digital. In the prior art, some signals representative of the data. A decryption device 
copiers have been able to rearrange the information on then performs decryption on the decoded data. An 
^ ""^^^^ P^''^ encryption One prob- output device then transfers the decrypted data onto a 
lem with providmg encryption through simply rear- 40 piece of plain paper 
rangmg the data on the page is that it isn't very secure. 

It would be advantageous to use a photocopier to per- BRIEF DESCRIFnON OF THE DRAWINGS 

StTs'^iSr ^^"^ ^ ^'"^ ^^"^ '^^ P^^^^ ^<l^^^o<^d more fully 

In the prior 'art, some limited methods for storing 45 ^^"^ <le.t^«d description given be^^^ 

digital information on phun paper have^en Lt fo^^ If^f^"^"^^ ^TTu ^'f'.f embodiments 

One example of digital information being stored on f the invention which, however, should not be 

paper is the use of bar codes. Bar codes arc smgle di- ^ f specific embodnnents. but are 

mension digital data in which typically ten digits of f^^^L^P^f^tion and understanding only, 

information are placed on a paper horizontally to store 50 . ' ^ ^ * ^^^^ diagram of one embodiment of the 

information. By scanning tiie bar codes in a relatively e^codrng process of the present invention, 

horizontal direction, the information encoded into the ^ embodiment of a block of encrypted 

bar codes may be read. These scans usually occur very <iata produced according to the present invcn- 
quickly . Note that the greater the height of the bar code 

(in the vertical direction), the less horizontal the scan is 55 ? i^usU^tes a single sheet of digital paper of the 

required to be to obtain the information. Also note that present inventioa 

because bar codes are horizontal, there is an inherent ^G- 4 is a block diagram of one embodiment of the 

linMt to the number of bar codes which may be used to decoding process of the present invention, 

store digital information on a piece of paper. For more fUG, 5 is a block diagram of the digital processing 

information on bar codes, see "Information Encoding 60 system of the present invention, 

with Two-Dimensional Bar Codes," authored by T. FIG. ^ is a flowchart of a decoding routine of the 

Pavlidis, J. Swartz and Y, Wang, COMPUTER, June decodmg process of the present invention. 

1992. See also U.S. Pat. No. 5,113,445 disclosing the FIG. 7 illustrates one embodiment of the data box of 

placement of bar codes onto paper. It is desirable to the present invention bemg subjected to the decoding 

store more digital information on a piece of plain paper 65 routine of the present invention, 

than by using bar codes, FIG. 8 is a block diagram of one embodiment of the 

The present mvention provides a method and appara- encoding process of the present invention that includes 

tus for placing data on plain paper. In one embodiment, encryption. 
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FIG. 9 is a block diagram of one embodiment of the see Richard E. Blahut, Theory and Practice of Error 
decoding process of the present invention that includes Control Codes, Addison- Wesley, 1983. 
decryption. As will be described below, in one embodiment, the 

DETAILED DESCRIPTION OF THE , t^t^'^^.Z^^^on^^^"^ '^'f^ 

mVENTlON correcUon code is mter- 

iJNVjiiNiiuxN leaved by an amoimt equal to the number of bytes 

A method and apparatus for placing digital data onto stored in one box on the page. It is therefore possible to 

plain paper is described. In the following description, lose an entire box without any uncorrectable errors. In 

numerous specific details are set forth such as process- this embodiment, one byte from each of the first ten 

ing steps, numbers of boxes, compression and encryp- 10 boxes is used to compute the parity bits which are 

tion techniques, etc., in order to provide a thorough stored in the final two boxes. Note that in the present 

understanding of the present invention. It will be obvi- invention the boxes with the parity bits are no different 

ous, however, to one skilled in the art that the present the other boxes of digital data on the plain paper, 

invention may be practiced without these specific de- One parity box can be lost and the entire message can 

tails. In other instances, well-known operations have still be constructed just as for the data boxes. In one 

not been described in detail to avoid unnecessarily ob- embodiment, twelve bopces of data are used for data 

souring the present invention. storage on the paper. 

Note that there is an advantage to using information 

Overview of the Encoding Process of the Present about the formatter to select the parameters the error 

Invention 20 correction. That is, since error correction can group 

FIG. 1 Ulustrates the encoding process of the present °^ together, if the location of the bytes on 

invention. The encoding process produces a sheet of P^^e is known, then bytes used in the error correc- 

paper which stores digital information. Thus, the result ^ ^^^^ ^^^^ separated on the page. In 

of the encoding process of the present invention is "dig- *^ manner, error correction results which can better 

ital" paper handle situations where a large portion of the plain 

Referring to FIG. 1, in the present mvention, data P^P^^ ^ sustamed damage (for instonce, such as the 

source 101 comprises digital data. In one embodiment, t "^5^ ^^^\ ^ ""^^^^ Parameters 

data source 101 is derived from a source of data that is f^^^ ^^°!f^ ^^.^^ ^^^J^ V ^^fV 

scanned by a scamiing device. In one embodiment, the ,^ resolution scanner is used m decodmg then the 

scamiingdeviceisthescamierportionofaphotocopier. <^der could at^^ 

Th«77r*ii;c o«,K«rii«««f in-i « has a large platen, then more mformaUon can be 

Inus, m this embodiment, the data source 101 is a scan /«n ♦u;!^^ u« i\ xr •* • i 

rtf «or«., decoded (all other tmngs bemg equal). If it is known 

of paper on the photocopier glass. Note that m the ^ ^ particular receiver is hiWy noisy, then a more 

cZwl'iS^^^ robust e^correctionmethodSdbe'^sed. 

comprises digi^ data. Note also that^e compre^ion 35 ^^^^ ^^^^ is in digital form, any de- 

performed on the data has been sigmfied m FIG. 1 by 3^,^ compression has occurred (prc^essmg Wock 102), 
compression processing 102 In other mbodiments, J^sired error correction encodbg has been 

dato source 101 could come from an ASCII data file, a performed (processing block 103), the distal data is 
Ki^f^TT*^ color image or even a bmary execut- formatted into distinct colored pixels (processing block 
able fOe. In other words, the data source 101 of the 40 104) ^hich can be printed. In one ^nbodiment, the 
pr^ent mvenUon can come from any source, mcludmg digital data is formatted into black and white pixels. In 
text, fax data, gray scale or even color image data. It one embodiment, the pixels are printed by the printer 
should be noted that m the present mvention, compres- portion of the photocopier. 

sion may or may not be performed. If compression is The formatting step of the present mvention (process- 
performed, vanous forms may be utilized, includmg 45 j^g block 104) is responsible for changing a digital bit 
both lossy and lossless compression techniques depend- sequence into a form which can be accurately scanned 
mg on whether the compressed data must be recreated and a format which is readable by the printer. In one 
m the exact form as the original. embodiment, the formatter produces a Postscript tm 

Once the data source 101 is m digital form and any file which can be printed on a laser printer, 
desired compression has taken place (processing block 50 After formatting (processing block 104), the data is 
102), error correction encoding may be perfbrmed (pro- printed (processing block 105). In one embodiment, 
cessmg block 103). Smce the plam paper is used as a where the formatting process produces a Postscript file 
digital channel, the error correction of the present in- describing the page of the formatted data, the Postscript 
vention can be viewed as just another box with digital file is then printed on a high quality Postscript printer, 
mput and digital output. Error correction encoding 55 such as the LaserWriter IINT brand printer of Apple 
(processing block 103) comprises adding correction or Corporation of Cupertino, Calif, 
"parity" bits to the digital information of the encrypted In order to write the bits on the paper, initially a 
data source 101. In one embodiment, the error correc- stream of data to be stored on the piece of paper is 
tion is performed using software. The software used to stored as a block of black and white dots, or data pixels, 
perform error correction is a shortened-interleaved 60 on the paper. In one embodiment, a "1" bit can be 
Reed-Solomon code over GF (25(5) to provide the for- stored as a white dot and **0" bit as a black dot. The data 
ward error correction. In the Reed-Solomon code over pixels utilized must be larger than the scanning resolu- 
GF (256), one byte of data is taken from each box and tion so that the scanning sample will lie within the 
combined using additions and multiplications in a finite printed pixel. In addition, a frame (or border)is placed 
field to produce two checksum bytes. In one embodi- 65 around the block of data so that the position to read 
ment, these bytes are encoded in the final two boxes on each pixel from can be accurately determined. An ex- 
the page. For more information on Reed-Solomon Cod- ample of one such digital data box is shown in FIG. 2. 
ing including the terms "shortened" and "interleaved", If the data block is too large, problems with paper 
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stretch and scanner misalignment may make reconstruc- ations, technical problems or other paper imperfections 

tion of the ongmal data difficult. and damages. 

Referring to FIG. 2, in the currently preferred cm- Once any required error correction is performed, the 

"^^^i ? ^"^I 'P^'^^ aligmnent data may undergo decompression (processing block 

could be detenmned, the black and white bits are placed 5 404). The decompression performed depends on 

m sev^ box^ on the page. In one embodiment, whether compression was performed during the encod- 

twelve boxes of data are used for each 8i X 1 1 inch sheet ing process and is performed to restore the data, as near 

ot paper. In one embodiment, each box has a border that as possible, to its original form 

IS three data pixels thick and mostly black. By having a. After decoding (processing block 402), error detec- 

bordcr around each box. It is easier to locate the edge of 10 tion and correction (processing block 403) and any 

the box (when decoding). Note also that in each comer desired decompression (processing block 404), the re^ 

of each box, there is a large white pixel. An examination constructed data is available and can be printed, dis- 

of the box also reveals alternating pixels along both the played or stored on a disk. In one embodiment, the data 

left and nght edges. These are used to accurately deter- is printed (processing block 405). In one embodiment, if 

mme the current location of a horizontal line of pixels 15 the original data was a simple scan, a copy of the origi- 

when reading the data. Note that the alternating pattern nal can be printed. In another embodiment, if the origi. 

of black and white pixels is added to the left and right nal data was several pages of ASCH or Postscript data, 

edges of each box to compensate for the possible vari- the dau can be printed or stored in a file. In another 

ancem the vertical spacmg of the pixels. These altcmat- embodiment, if the original was a JPEG compressed 

mg pixels are not required where the vertical spacing ^ color image, the image may be displayed, 
between the pixel rows does not vary by an amount 

which would cause the incorrect reading of the data ^® Embodiment of the Encoding/Decoding System 

(upon decoding). of the Present Invention 

Note that although twelve smaU boxes each storing FIG. 5 IDustrates an overview of one embodiment of 

several bytes of data is used in one embodiment, any the encoding and decoding system of the present inven- 

numbcr of boxes could be used, including only a single tion shown in block diagram form. The system of the 

box. This IS a design choice. A smaU box uses more present bvcntion is a digital processmg system. In the 

overhead for the frame, and the space between the currently preferred embodiment, the digital processing 

boxes is unused for daU, but requires less correction 3^ system comprises a digital photocopier. In one embodi- 

data to be added to the encoded data (i.e., a lower error ment, the operation of a digital photocopier is simulated 

1 t. losing a scanner, printer and computer. It will be under- 
Note also that the present invention may use gray- stood that while FIG. 5 is useful for providing an over- 
scale inks and store additional information in the gray all description of the processing system of the present 
level. In this manner, for example, eight shades of gray 35 invention, a number of details of the system are not 
could be used to obtain three bits of data from a gray- shown. As necessary for disclosure of the present inven- 
scalc prmter and scanner. tion, further detail is set forth with other figures pro- 
Overview of the Decoding Process of the Present ^ specification. Further, the present in- 
Invention vention is described with reference to its preferred em- 
r?T^ A n ^ 40 bo<lhDent; alternative embodiments which may be con- 
FIG. 4 lUiKtrates the decoding process of the present ceived by one of ordinary skiU in the art are considered 
invention. The decodmg process of the present inven- within the scope of the claims set forth below 
tion mverts the operation of the encoding process one Referring to FIG. 5, the system of the present inven- 
step at a tune. Imtially, the sheet of digital paper is tion includes a bus or other communication means 501 
scanned (processing block 401 ). The scanned data is 45 for communicating information. Processor 502 is cou- 
then sampled to produce a binary sequence representing pled with bus 501 for processmg information. A random 
?^If«lt^ v7®** encoding process (processing access memory (RAM) or other dynamic storage de- 
block 402). Note that tiie result of the scan is a binary vice 503 (commonly referred to as a main memoo^) for 
s^uence which is close to the one given to the encoder. storing information and instructions for processor 502 is 
The result of the scannmg may not produce an exact 50 also coupled to bus 501. Also coupled to bus 502 is a 
duphcate of the data sent to the encoder. This may be read only memory (ROM) or other static storage device 
due to enors m the scanning of tiic data. For instance, 504 for storing static information and instructions for 
an exact duphcate may not be sent to the decoder due to processor 102 and a data storage device 505, such as a 
errors in the registration, flatness, skew, or scanner magnetic disk and disk drive for storing information and 
defects dunng the scanning process. 53 instructions. 

• P^^^ decoded (process- The processing system also includes a scanner 506 

mg block 402), error detection and correction is per- coupled to bus 501 for scanning selected hard copy 

termed (processmg block 403). The error correction documents into the processor. Scanner 506 is capable of 

compensates for the loss of data due to damage to the reading digital representations of images (i.e., digital 

paper or due to the failure to predict the pixel location 60 paper), as well as regular images. In order to differenti- 

cOrrecUy. The error detection and correction process- ate between whether scanner 506 is reading a regular 

mg (processmg block 403) is the inverse of the error image or a piece of digital paper, some form of automa- 

correction cncodmg which occurred during the encod- tion could be employed to search a portion of the docu- 

ing process QFIG. 1). The error detection and correc- ment to determine that the hard copy document being 

tion occurs by using the parity bits added during the 65 scanned is a piece of digital paper. In another embodi^ 

encodmg process of FIG. 1 to correct errors which may ment, a key could be entered which indicates to scanner 

have occurred (processmg block 403). The errors may 506 that the hard copy being scanned is a piece of digital 

be attributed to staples, hole punches, paper discolor- paper. 
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In one embodiment, scanner 506 comprises a gray Scannin Di *tal Pa er 

scale scanner. In the currently preferred embodiment, ^ ^ ^^^^ 

this resolution is 200 DPI. Scanner 506 converts the In order to decode the digital paper, the entire sheet 

individual picture elements, referred to as pixels, of the ^ scanned with a scanner at high resolution. In one 

scanned image into digital values. In one embodiment, ^ embodiment, the entire sheet is scanned with a gray 

scanner 506 comprises an Image Scanner ICS-400 brand scale scanner. A software routine is used to generate a 

scannerofRicoh Corporation ofWestCaldwell,N.J.In binary sequence from the scanned in data. The result 

other embodiments, scanner 506 is a bitmap scanner Produced by the software routme is a bu^ sequrace. 

..ruir.u c^«c u^^A A flow chart of the decodmg routme is shown m FIG. 

which scans the image of each hard copy mput docu- ,^ ^ xt * * r^rr^ -» -n . * r*i. j j- 

ment m a predetermLed spatial resolution to produce ^ ^^^^^^ ^ P^^^'^ ^^^^ 

digital values. These digital values collectively produce P'S^^rring to FIG. 6, once the digital paper is scamied 

a data structure known as a bitmap miage, which is ^^^^ ^p,^ ^^^^^ ^^f^^^ ^^^^ 

wdl-known to those m the art. locating the boxes on the page by searching for the 

Note that processor 502 performs the error correc- ^ jji^ck border (processing block 601). In one embodi- 
tion encoding, encoding, decoding, and error detection ment, the search for the black border is accomplished 
and correction processes of FIGS. 1 and 4 in conjunc- by scanning a row until a predetermined number of 
tion with the input from scanner 506. Note also that black pixels are found in a row. In the currently pre- 
processor 502 may also perform encryption and decryp- ferred embodiment, the borders are 3 pixels thick. The 
tion if employed in the digital paper process. Thus, in 20 number and approximate position of the boxes on the 
one embodiment, processor 502 operates as the encoder page is assumed to be known by the decoding process 
and the decoder of the present invention. In one em- (since how the digital paper is produced is known by 
bodiment, processor 502 comprises a SPARC station 2 the decoding process). However, this is not a require- 
brand processor of Sun Microsystems, Inc. of Mountain nient since the frame should be easy to identify even on 
View, Calif. 25 a page full of text Note also that in one embodiment, 

A hard copy device 507 is also coupled to bus 501 for the size of the boxes is known to the decoding process, 

printing hard copies for providing visual representa- Therefore, once a border has been located, the other 

tions of the scanned originals. In one embodiment, hard borders are located by searching the vertical and hoxi- 

copy device 507 comprises the printer portion of a pho- fontd directions mitd the ojer borders of the box are 

tocopier. In other embodiments, hard copy device 507 ^^''T^^ ^ u . i 

/.or«««c« o «i/.fto,. «^ •^««*o*. ^..rXi « ui*^^^ bordcrs of the data blocks have been lo- 

could comprise a Plotter or printer, such as a bitmap ^^^^ ^^^^^^ 

pnnter inat maps tne mgitai values o a bitmap miage (processing block 603). In one embodiment, 

mto pixels whidi are prmted on the plam paper. ^^i^^ j^^^^ ^ searching the comers 

Morwver, a hmnan or user mterface 508 is mcluded 35 fo, brightest pixel. Since the scamiing resolution 
for enabhng a user to mtcract with processor 502, scan- c>ne embodiment is at least twice the printing 

ner 506 and hard copy device 507. User interface 508 resolution, each comer should have several white 
represents the input and output devices through which scanned pixels. 

the user enters control instructions to and receives feed- Because an encrypted page may be copied several 
back from the photocopier (i,e., processor 502, scanner 40 times, the spacing between information pixels may 
506 and hard copy device 507). The feedback indicates change and the rows of pixels will not be perfectly 
the actions that are taken by the photocopier in re- aligned with the scanning row. The brightest pixel is 
sponsc to instructions that arc entered by the user. User used as the correct position to find the remainder of the 
interface 508 may be used to enter a key for encryption data. In other words, the four white comer dots are 
and decryption processes, as will be described in con- 45 used by the present invention to determine the horizon- 
jimction with FIGS. 8 and 9 below. tal spacing between the information pixels withm the 

User interface 508 could include an alphanumeric boxes. Once the width and height of the box (in number 
input device including alphanumeric and other keys for pixels) are known and the comers have been 

communicating information and command selections, a located, the horizontal and vertical spacing is deter- 
cursor control device for controlling cursor movement ^0 niined (processing block 604). 

and/or a display device, such as a cathode ray tube, '^^ horizontal and vertical spacing when the 

liquid crystal display, etc. for displaying information to <^omcts have been found, the alternating pattern of 
the photocopier user. Note that these components are ^Iff P^f^^ . "8^^ 

weU-known in the art and have been omitted to avoid „ box dunng the enccding process to compensate 

minecessarily obscuring the present invention. Note for the variance of the vertical spa^^ 
^, ^ . .J. ^ • ^ _p r.fto determme the vertical spacmg between the mformadon 

that m one embodmient, user mterface 508 may pro^ade ^^j^ two comers are joined by an imagi- 

mputs directiy to seamier 506 and hard copy device 507 ^ (processing block 604A). The joi^ig of the 

wjch can be distinct from those mputs to processor ^^^^^ ^^^y^^^^ ^^own in FIG 7. A syn- 

^ ^ ^ ^ • ^ ^ chronization colunm is then approximated as a fraction 

Note that, although m the currentiy preferred em- of ^ distance between the comers (processing block 
bodiment, all of these components are mtegrated mto a ^g), synchronization column has been shown as 
single photocopier system, each of the components, an imaginary line in FIG. 7. Next, the decoder finds all 
such as scanner 506 and hard copy device 507, may be ©f the transitions in the synchronization column (pro- 
separate components. In one embodiment, scanner 506 $5 cessing block 604C). In one embodiment, the decoder 
and/or hard copy device 507 could be coupled to bus records the location of every black-to-white or white- 
502 using dedicated communication links or switchable to-black transition. Then, starting from the point be- 
communication networks. tween two transitions on the left, an imaginary line can 
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be drawn to the pdnt between two transitions on the allowed, the scanning resolution can be much closer to 

right (processing block 604D). Note that these lines arc the printing resolution and much more data can be 

drawn in FIG. 7. Even though one of the rows of data stored on a page, 

is much shorter than the others and one is much taller, Normal scanner/photocopier covers keep paper from 
the correct place to read the rows can stiU be deter- 5 shifting away from the scanner lens and prevents bad 
mined. Finally, since the number of data pixels is lighting from occurring during the scanning process, 
known, this horizontal line can be divided into the cor- Note that during the scanning process, scanning errors 
rect number of pieces and sampled at the correct loca- can be reduced by ensuring that the plam paper is kept 
tion (processing block 6D4E). flat enough to maintain accurate pixel spacing. There 
With the vertical and horizontal spacing determined, 10 are numerous methods and devices which may be used 
It is possible to compute the two dimensional grids from to keep the paper flat and in place during scanning, 
which the data pixels can be sampled. Finally, the data Thus, the present invention provides a method and 
box is examined horizontally and if the sample at the apparatus for storing and transferring digital data on an 
predicted location is closer to black than white, a 0-bit ordinary sheet of paper, as well as retrieving the data 
is emitted; otherwise, a Kbit is emitted (processing 15 through the use of a digital scanner. Neither the encod- 
block 605). In one embodiment, a bi-linear interpolation ing nor the decoding of the data require very much 
of the four pixels closest to the desired location is used processing power. The present invention allows the 
to determine the value of the data. Given an interpola- storage of more than 15 kilobytes of information virtu- 
tion of the value of the pixel at the real location, the aUy error free. The present mvention also provides a 
average is compared with expected values for white or 20 method of digital transmission which aUows more data 
black pixels. Then if the sampled pixel is closer to white, to be stored on a page than text currently does. A typi- 
the pixel is assumed to be a "1" data bit; otherwise, the cal page or text may have forty lines of eighty charac- 
data is assumed to be a "0" data bit. Note that other ters or 3,200 total characters. If each character truly 
methods of interpolating and sampling may be used and represented eight bits of information, then one page 
arc known to those skilled in the art For example, a 25 would hold three kilobytes. Use of the present mvention 
faster method would use the pixel closest to the desired results in the storage of more than 15 kilobytes of data 
sample pomt without any interpolation. on a page. If the original text is English, it can be corn- 
Note that encoding digital paper is similar to disk pressedbyafactor of three and then one sheet of digital 
storage because binary data is mapped mto space. paper could be used to store the equivalent of 15 pages 
Therefore, well-known disk storage systems, such as 30 oftext Also, it is possible to store a normal color image 
RLL, MFM, M2FM and others, can be used to improve on a black and white copy by storing the information 
encoding. Most of these methods utilize data transitions digitally. Even more data could be stored with the 
rather than data states. Data would then be encoded by previously mentioned disk storage codes, 
the location of a change from one color to another. Furthermore, the present invention allows for digital 
rather than the color itself. Another possible improve- 35 data to be printed and read by off-the-shelf photocopier 
ment is using the ink transitions to accurately determine products. In other words, the present invention does 
the pixel spacing and data locations. The transitions not require special laser scanners or hand-held wands to 
thus provide not only data, but also the pixel spacing. transfer digital data to and from a piece of plain p^. 



Decoding is done with a phase lock loop algorithm, 
Pixel Size and Paper Curl 



^ Encryption 

In one embodiment, encryption and decryption may 

In the present invention, the size of the pixel is influ- be integrated into the encoding and decoding processes 

cnced by two considerations. First, the size of the pixel of the present inventioa Note that in one embodiment 

is influenced by the amount of information that is to be of the present invention, this would occur after the 

placed onto the paper. The smaller the size pixel, the 45 compression of the digital data (processing block 102 of 

greater the amount of information which may be placed FIG. 1). One embodiment of the encoding process that 

onto the paper. Second, the size of the pixel is mflu- includes encryption is shown in FIG. 8. Note that each 

enced by the capability of the scanner used to scan the of the processing blocks in FIG. 8 are performed as 

data from the paper when decoding. The smaller the their similarly named counterparts in FIG. 1, with the 

pixel, the higher the scan rate that is required. 50 exception of encryption processing block 803. 

In one embodiment, the data pixels are printed at 50 In one embodiment, the encryption is accomplished 
DPI. while the scanning is performed at 200 DPI. This using software. In one embodiment, the software en- 
allows fast decoding and error correction which results cryption is provided by exclusive-ORing the initial data 
m zero errors being observed in the digital data. Print- with a pseudo-random sequence generated using a se- 
mg of data pixels can occur at 100 DPI and scanning at 55 cret key as a seed. Note that in this case, the decryption 
400 DPI to increase the storage on a single sheet of process (as described below later)is simply exclusive- 
paper from 15 kilobytes to 60 kUobytes, ORing the data with the same pseudo-random sequence. 

Note that the current software uses a parameter file to Note that this type of encryption process is not per- 

set the printing and scanning resolutions and box sizes. fectly secure method of data encryption because of the 

In this manner, changes to each of these parameters 60 short key length used to seed pseudo-random sequences 

may be made easily. It is possible to print at 50 DPI and and the fact that the same key is likely to be used on 

scan at 200 DPI without errors. It is also possible to more than one message. There are well-known methods 

print at 100 DPI and scan it, 400 DPI without errors. to attack this type of encryption. 

This would aUow more than 60 kilobytes of dau per In order to obtain secure data through encryption, a 

page to be stored. If absolutely error free operation is 65 one time pad can be employed in place of the pseudo- 

not required, a wide variety trade-offs between printing random sequence. A one time pad comprises a series of 

size, scannmg size, amount of error correction, and randomly generated bits that are known to both parties 

error percentage is possible. In general, if errors are (i.e., the "encrypting" party and the "decrypting" 
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party) and is only used once in the encryption process. 
In a one time pad, the key length is equal to the message 
length and may be more than 100,000 bits. Since the one 
time pad is used once, it is not susceptible to the same 
attacks which are used on pseudo-random sequences. 5 

In another embodiment, encryption processing could 
be performed using the digital encryption standard 
(DES) or the RSA algorithm. In the RSA algorithm, 
digital data is encrypted using two prime numbers 
which are multiplied together, as is wdl-known in the 10 
art In the case where each of the two prime numbers 
has approximately 200 digits, the RSA algorithm offers 
a very secure encryption method. Note that to use DE 
S in one of the feedback modes or to use the RSA algo- 
rithm, it is necessary that errors do not occur in the 15 
encoding and decoding of the digital data stream. If an 
error occurs, any information beyond the location of 
the error would be lost. Alternatively, the encryption 
process can periodically be restarted so that only a 
portion of the message is lost if too many errors occur. 20 
It should be noted that any digital encryption method 
may be employed with the present invention. 

Similarly, if encryption is integrated into the encod- 
ing process, then decryption must be included in the 
decoding process. One embodiment of the decoding 25 
process of the present invention that includes decryp- 
tion is shown in FIG. 9. Note that each of the process- 
ing blocks in FIG. 9 are performed in the same manner 
as their similarly named coimterparts in FIG. 4, with 
the exception of decryption processing block 904. 30 

After error detection and correction (processing 
block 903), the data undergoes decryption (processing 
block 904). The decryption processing (processing 
block 904)is the inverse of the encryption performed 
during the encodmg process (FIG. 8). In one embodi- 35 
ment, the decryption process requires the use of the 
saihe key used during encryption. By using the same 
key, the original data is recreated. 

When the methods of encryption (and decryption) of 
the present invention are being integrated into the en- 40 
coding and decoding processes, the present invention 
also provides data information to be transferred using 
plain paper in a manner which preserves its privacy 
and/or authentication. In the present invention, this 
privacy can easily be obtained through the use of a key 45 
or code known to the user(s) when encryption and 
decryption of a document occurs. Note that the present 
invention provides for encryption of information using 
the photocopier. Using the present invention, a user 
could place a confidential document on a copier, press 50 
an encrypt button and enter a secret key. The copier 
would then scan the sheet and produce an encrypted 
copy, llxis encrypted copy could be mailed or otiier- 
wise transported to the intended receiver, who places it 
on a copier, presses a decryption button and enters the 55 
same secret key. The copier then produces a readable 
copy of the original document. The present invention 
also allows the encrypted copy to be treated as a normal 
document and be copied or stapled without greatly 
affecting the fmal decrypted document. The present 60 
invention also provides for secure encryption of a docu- 
ment because any person who does not know the secret 
key will be unable to determine the contents of the 
encrypted document 

Another useful application of the present invention is 65 
the authentication of a document. Specifically, the pres- 
ent invention could be used to authenticate signed fac- 
sunile transmissions. Through the use of digital signa- 
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tures, authentication could be simple. If a photocopier 
allowed digital signing of a document, then digital sig- 
natures could be used for all business transactions. The 
authentication might consist of a small block of digital, 
encrypted data on an otherwise human readable docu- 
ment. Using the secret key, a person would be able to 
obtain the digital data in the small block, therein being 
able to verify its source. In addition, the codes could 
prevent forgery or provide secret information since 
only those using the correct key or code would be able 
produce the digital paper. 

Whereas many alterations and modifications of the 
present invention will no doubt become apparent to a 
person of ordinary skill in the art after having read the 
foregoing description, it is to be understood that the 
particular embodiment shown and described by way of 
illustration are in no way intended to be considered 
limiting. Therefore, reference to the details of the prc- 
fened embodiments are not intended to limit the scope 
of the claims which themselves recite only those fea- 
tures regarded as essential to the invention. 

Thus, a method and apparatus for placing digital 
information on plain paper has been described. 

I claim: 

1. A system for placing a data source on plain paper 
as digital data comprising: 

formatting means for formatting the data source into 
a series of digital data values, wherem the series of 
digital data values are formatted into a plurality of 
contiguous rows and a plurality of contiguous col- 
umns of pixels in at least one data box, wherein 
each pixel represents at least one bit in the series of 
digital data values, and further wherein the data 
box includes a frame bordering the series of digital 
data values having alternating pixels along at least 
two opposite sides for identifying the vertical sepa- 
rations between the plurality of rows of data and 
having pixels in comers in the frame to determine 
horizontal spacing between pixels within said at 
least one data box; and 

printing means coupled to the formatting means for 
printing said at least one box onto at least one piece 
of plain paper having the plurality of rows and the 
plurality of columns, such that the data source is 
represented in digitized form on the plain paper, 

2. The system as defined in claim 1 wherein the for- 
matting means formats the data into a series of binary 
values. 

3. The system as defined in claim 1 wherein a plural- 
ity of boxes having data values are printed on the plain 
paper. 

4. The system as defined in claim 1 wherein a bit of 
data is printed on the plain paper, such that the presence 
of a dot on the plain paper mdicates that the bit is in a 
first logical state and the absence of a dot on the plain 
paper indicates that the bit is in a second logical state. 

5. The system as defined in claim 1 wherein a bit of 
data is printed on the plain paper, such that the change 
between the presence or absence of a dot on the plain 
paper indicates whether a bit is in a first logical state or 
is in a second logical state. 

6. The system as defined in claim 1 wherein each pixel 
value printed represents three bits of data. 

7. The system as defined in claim 1 further comprising 
compression means for compressing the data source 
before the formatting means formats the data. 

8. A system for placing a data source on plain paper 
as digital data comprising: 
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formatting means for formatting the data source into 
a series of binary values, wherein the series of bi- 
nary values are formatted into a plurality of contig- 
uous rows and a plurality of contiguous columns of 
pixels in a plunJity of data boxes, wherein each 5 
pixel represents at least one bit in the series of hi* 
nary values, and further wherein each of the plural- 
ity of data boxes includes a frame bordering the 
series of binary values having alternating pixels 
along at least two opposite sides for identifying the 10 
vertical separations between the plurality of rows 
of data and having pixels in comers in the frame to 
determine horizontal spacing between pixels; and 

printing means coupled to the formatting means for 
printing said plurality of data boxes onto at least 15 
one piece of plain paper, wherein the presence of a 
dot on the plain paper indicates that the bit is in a 
first logical state and the absence of a dot on the 
plain paper indicates that the bit is in a second 
logical state, wherein the plurality of contiguous 20 
rows and a plurality of contiguous coliunns of pix- 
els are printed in the plurality of rows and the 
plurality of columns in the plurality of data boxes, 
such that the data source is represented in digitized 
form on the plain paper. 25 

9. The system as defined in claim 8 further comprising 
compression means for compressing the data source 
before the formatting means formats the data. 

10. The system as defined in claim 8 further compris- 
ing means for error correction. 30 

11. The system as defined in claim 8 wherein each 
pixel value printed represents a plurality bits of data. 

12. A system for decoding plain paper having at least 
one data box for storing binary data values in the form 
of pixels, wherein said at least one data box includes a 35 
plurality of borders, said system comprising: 

first locating means for locating means for locating 
said at least one data box on the plain paper, 
wherein said first locatiog means includes means 
for scanning rows of the plain paper until a prede- 40 
termined number of contiguous pixels of a first 
color are located in a row, such that said first locat- 
ing means locate one of the plurality of borders, 
said first locating means further comprising mpaTiy 
for locating the other of the plurality of borders; 45 

second locating means for locatmg pixels of a second 
color in comers of the plurality of borders of said 
at least one data box; 

third locating means for locating the plurality of rows 
of pixels in each said at least one data box on the 50 
plain paper; 

decoding means coupled to the first locating means, 
the second locatmg means and the third locating 
means for decoding each pixel in the plurality of 
rows into a binary data value, wherein the presence 55 
of a dot on the plain paper indicates that the bit is 
in a first logical state and the absence of a dot on 
the plain paper indicates that the bit is in a second 
logical state, and further wherein the decoding 
means locates pixels in said at least one data box $0 
based on horizontal spacing of pixels determined 
by the second locating means and vertical spacing 
of pixels determined by the third locating means, 
such that the plain paper is decoded. 

13. The system as defined in claim 12 wherein said at 65 
least one data box includes at least two opposite edges 
having markers for identifying the vertical separations 
between the rows of data in said each of the plurality of 
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data boxes, such that said third locating means locates 
each of the plurality of rows of binary data using said at 
least two opposite edges. 

14. A method for placing digital data on plain paper 
comprising the steps of: 

formatting the data source into a series of binary 
values, wherein the series of binary values are for- 
matted into a plurality of contiguous rows and a 
plurality of contiguous columns of pixels in a plu- 
rality of data boxes, wherein each pixel represents 
at least one bit in the series of binary values, and 
further wherein each of the plurality of data boxes 
includes a frame bordering the series of binary 
values having alternating pixels along at least two 
opposite sides for identifying the vertical separa- 
tions between the plurality of rows of pbcels and 
having pixels in comers in the ft^e to determine 
horizontal spacing between pixels within said at 
least one data box; and 

printing the plurality of data boxes onto at least one 
piece of plain paper, wherein each of the plurality 
of binary values is either printed or not printed 
according to its logic state, such that the presence 
of a dot on the plain paper indicates that the bit is 
in a first logical state and the absence of a dot on 
the plain paper indicates that the bit is in a second 
logical state, wherein the binary values are printed 
^in the plurality of rows and the plurality of columns 
in the plurality of boxes, such that the data source 
is represented in digitized form on the plain paper. 

15. A method for decoding plain paper having at least 
one data box for storing binary data values in the form 
of pixels, said method comprising the steps of: 

first locating said at least one data box on the plain 
paper, including the step of scanning rows of the 
plain paper until a predetermined number of con- 
tiguous pixels of a first color are located in a row, 
such that one of a plurality of borders of said at 
least one data box is located, and including the step 
of locating the other of the plurality of borders; 

second location pixels of a second color in comers of 
the plurality of borders of said at least one data box, 
wherein horizontal spacing of pixels in said at least 
one data box is determined: 

third Locating the plurality of rows of pixels in each 
of said at least one data box on the plain paper, 
wherein vertical spacing of pixels in said at least 
one data box is determined; 

decoding each pixel in the plurality of rows into a 
binary data value, wherein the presence of a dot on 
the plain paper indicates that the bit is in a first 
logical state and the absence of a dot on the plain 
paper indicates that the bit is in a second logical 
state, and further wherein the pixels in said at least 
one data box are located based on horizontal spac- 
ing of pixels determined by the second locating 
step and vertical spacing of pixels determined by 
the third locating step, such that the plain paper is 
decoded. 

16. A reproduction system for reproducing a data 
source comprising: 

encryption means for performing encryption on the 
data source to produce encrypted data represent- 
ing the data source, wherein the data source is 
digital and the encrypted data produced is digital; 

encoding means coupled to the encryption means for 
encoding the encrypted data into a series of pixel 
values; and 
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printing means coupled to the encoding means for 
printing the series of pixel values onto at least one 
piece of plain paper, wherein the pixel values are 
printed in at least one box in a plurality of contigu- 
ous rows and a plurality of contiguous columns of 5 
pixels, wherein each pixel represents at least one bit 
in the series of digital data values, and wherein said 
at least one box includes a frame bordering the 
series of pixels having alternating pixels along at 
least two opposite sides for identifying the vertical 10 
separations between the plurality of rows of data 
and having pixels in comers in the frame to deter- 
mine horizontal spacing between pixels within said 
at least one data box, such that the data source 
represented in encrypted digitized form on the 15 
plain paper. 

17. The reproduction system as defined in claim 16 
further comprising scanning means for scanning the 
data source into digitized signals. 

18. The reproduction system as defmed in claim 16 20 
further comprising means for performing error correc- 
tion encoding on the encrypted data. 

19. The reproduction system as defined in claim 16 
wherein the encryption means uses a digital key. 

20. The reproduction system as de^ed in claim 19 25 
wherein the key seeds a pseudo-random sequence. 

21. The reproduction system as defined in claim 19 
wherein the key comprises a one-time pad. 

22. The reproduction system as defined in claim 16 
wherein the encryption means includes means for en- 30 
crypting the data according to the digital encryption 
standard (DES). 

23. The reproduction system as defined in claim 16 
whereia the encryption means includes means for en- 
crypting the data according to the RSA algorithm. 35 

24. A system for representing and recognizing data 
on plain paper in the form of a plurality of data boxes 
comprising: 

encoding means for encoding the data, wherein the 
encoding means includes: 40 
encryption means for performing encryption on 
the data source to produce encrypted data repre- 
senting the data source, wherein the data source 
is digital and the encrypted data produced is 
digital; 45 
encoding means coupled to the encryption means 
for encoding the encrypted data into a series of 
pixel values; and 
first output means coupled to the encoding means 
for outputting the series of pixel values onto at 50 
least one piece of plain paper, wherein the series 
of pixel values are printed in at least one box in a 
plurality of contiguous rows and a plurality of 
contiguous columns and wherein said at least one 
box includes a frame bordering the series of pix- 55 
. els having alternating pixels along at least two 
opposite sides for identifying the vertical separa- 
tions between the plurality of rows of data and 
having pixels in comers in the frame to deter- 
mine horizontal spacmg between pixels within 60 
said at least one data box, such that the data 
source represented in encrypted digitized form 
on the plain paper; and 
recognition means for recognizing the data in the 
plurality of boxes, wherein the recognition means 65 
includes: 

scanning means for scanning said at least one box 
on the plain paper and for converting the pixels 
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into electrical signals representative of the char- 
acters, wherein the scanning means scans rows 
of the plain paper until a predetermined number 
of contiguous pixels of a first color are located in 
a row, such that one of a plurality of borders of 
said at least one data box is located, and further 
wherein said scanning means locates the other of 
the plurality of borders, said scanning means also 
including means for determining the horizontal 
spacing and the vertical spacing of pixels in said 
at least one data box; 

decoding means coupled to the scanning means for 
decoding the electrical signals into output signals 
representative of the data; 

decryption means coupled to the decoding means 
for decrypting the electrical signals; and 

second output means coupled to the decrypting 
means for transferring the output signals onto a 
piece of plain paper. 

25. The reproduction system as defined in claim 24 
wherein the encryption means uses a digital key. 

26. The reproduction system as defined in claim 25 
wherein the key seeds a pseudo-random sequence. 

27. The reproduction system as defined in claim 25 
wherein the key comprises a one-time pad. 

28. A process for reproducing a data source compris- 
ing the steps of: 

performing encryption on the data source to produce 
encrypted data representing the data source, 
wherein the data source is digital and the en- 
crypted data produced is digital; 

encoding the encrypted data into a series of pixel 
values; and 

outputting the series of pixel values onto at least one 
piece of plain paper, wherein the pixel values are 
printed in at least one box in a plurality of contigu- 
ous rows and a plurality of contiguous columns and 
wherein said at least one box includes a frame bor- 
dering the scries of pixels having alternating pixels 
along at least two opposite sides for identifying the 
vertical separations between the plurality of rows 
of data and having pixels in comers in the frame to 
determine horizontal spacing between pixels within 
said at least one data box, such that the data source 
represented in encrypted digitized form on the 
plain paper. 

29. A process for decoding the data in the plurality of 
boxes comprising the steps of: 

scanning said at least one box on the plain paper and 
for converting the pixels into electrical signals 
representative of the characters, wherein each of 
the pixels; represents a binary value; 
decoding the electrical signals into output signals 
representative of the data, wherem the step of de- 
coding includes the steps of: 
locating the comers of said at least one box using 

pixels in the comers; 
determining the spacing of the pixels according to 
the location of the comers of said at least one 
box, wherein horizontal spacing of the pixels is 
determined using the pixels in the comers of said 
at least one box; 
locating the rows of pixels in said at least one box 
using alternating pixels along two opposite sides 
of said at least one box, such that the vertical 
separation between the plurality of rows of data 
is identified; and 
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sampling the pixels according to the horizontal 
spacing and the vertical separation in order to 
produce decoded data; 

decrypting the decoded data; and 

transferring the output signals onto a piece of plain 
paper. 

30. The process as defined in claim 29 wherein the 
step of decrypting the decoded data comprises the step 
of decrypting the decoded data according to a key. 

31. The process as defined in claim 29 wherein the 
step of decrypting the decoded data comprises the step 
of decrypting the decoded data according to a key 
seeding a pseudo*random sequence. 

32. The process as defined in claim 29 wherein the 
step of decrypting the decoded data comprises the step 
of decrypting the decoded data according to a key 
comprising a one-time pad. 

33. A system for placing a data source on plain paper 
as digital data comprising; 

a formatter, wherein the formatter formats the data 
source into a series of digital data values, wherein 
the series of digital data values are formatted into a 
plurality of contiguous rows and a plurality of 25 
contiguous columns of pixels in at least one data 
box, wherein each pixel represents at least one bit 
in the series of digital data values, and further 
wherein the data box includes a frame bordering 
the series of digital data values having alternating 30 
pixels along at least two opposite sides for identify- 
ing the vertical separations between the plurahty of 
rows of data and having pixels in comers in the 
frame to determine horizontal spacing between 
pixels within said at least one data box; and 

a printer coupled to the formatter, wherein the 
printer prints said at least one box onto at least one 
piece of plain paper having the plurality of rows 
and the plurality of columns, such that the data 4^ 
source is represented in digitized form on the plain 
paper. 

34. The system defined in claim 33 further comprising 
a data compresser coupled to receive the data source, 
wherein the data compresser compresses the data 4S 
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source and supplies the data source in a compressed 
form to the formatter for formatting. 

35. The system defined in claim 33 further comprising 
an error correction encoder coupled to receive the data 
source, wherein the error correction encoder performs 
error correction encoding on the data source and 
supplies the data source in an error correction encoded 
form to the formatter for formatting. 

36. A system for placing a data source on plain paper 
as digital data comprising: 

a data compresser coupled to receive the data source, 
wherein the data compresser compresses the data 
source to produce a compressed data source; 

an enor correction encoder coupled to receive the 
compressed data source, wherein the error correc- 
tion encoder performs error correction encoding 
on the compressed data source to produce a com- 
pressed and error correction encoded data source; 

a formatter coupled to receive the compressed and 
error correction encoded data source, wherein the 
formatter formats the compressed and error cor- 
rection encoded data source into a series of digital 
data values, wherein the series of digital data values 
are formatted into a plurahty of contiguous rows 
and a plurality of contiguous columns of pixels in at 
least one data box, wherein each pixel represents at 
least one bit in the series of digital data values, and 
further wherein the data box includes a frame bor- 
dering the series of digital data values having alter- 
nating pixels along at least two opposite sides for 
identifying the vertical separations between the 
plurahty of rows of data and having pixels in cor- 
ners in the frame to determine horizontal spacing 
between pixels within said at least one data box; 
and 

a printer coupled to the formatter, wherein the 
printer prints said at least one box onto at least one 
piece of plain paper having the plurality of rows 
and the plurality of columns, such that the data 
source is represented in digitized form on the plain 
paper. 

37. The system defined in claim 3 wherein at least one 
of the plurality of boxes contams error correction en- 
coded data for the other of the plurahty of boxes. 

***** 
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CONVERTING DOCUMENTS* WITH LINKS 
TO OTHER ELECTRONIC INFORMATION, 
BETWEEN HARDCOPY AND ELECTRONIC 
FORMATS 

FIELD OF THE INVENTION 

The present iovcntion relates to the field of document 
conversiOD and publication; more particularly, the present 
invendon relates to hardcopy document to hypcrdocument 
convenioD that permits the constniction of a hyperdocument 
complete with linJcs from a hardcopy version of the 
document, and vice versa. 

BACKGROUND OF THE INVENTION 

The **World Wide Web** (hereinafter referred to as 'the 
Web'*) is a term that describes the interconnected^ on-line 
documents that can be accessed via computer systems 
hooked to the Internet using software clients. In the pricr art 
these software clients are graphical browsers, such as 
Mosaic and Netscape, thdt permit a user to select various 
documents. Upon selection, a graphical browser retrieves 
the documents and provides them to the user, eiflier by 
displaying them on a di^lay screen or by causing them to 
be printed on a hardcopy device, such as a printer, or in case 
where the linked document is ao audio file or a movie file, 
the browser enables appropriate vendition. 

Portions of documents displayed using the graphical 
browser contain hypertext links. The bypeitext links link 
gr^>hics or text on one document with another document on 
ttit Web. Documents containing hypertext links are created 
prior to their "publishing** on the Web. That Is. a document 
that is to be published is provided to a server which creates 
the document and. essentially, publishes the document by 
permitting its access by others on the Web. Each hypertext 
link is associated with a Uniform Resource Locator (URL) 
that identifies and locates a document on the Web. When a 
user selects a hypertext link, using, for instance, a cursor, the 
gri^hical browser retrieves the corresponding (or linked) 
docuincnt(sj. 

In order to aeate documents containing a hypertext link, 
an individual imist specify the specific portion, or active 
region, of the document that will be responsive to selection 
by Oie user. An individual also must identify the specific 
hypertext link information, inchiding the URL. to set forth 
the resource or document that is to be located on the Web 
when die particular active region is selected by the user. 
Once both the active portions of the docimient and their 
corresponding hypertext links have been selected, an 
application, such as Mosaic, fnrocesses the information and 
produces the document. Note that such a process is not 
automatic and requires user interaction in order to specify 
these specific locations and hypertext links. It is desirable to 
automate such a process to allow the user to create a 
document having hypertext links without interactively 
specifying both active regions and their links. That is. it is 
desirable to have a passive hyperdocument creation system 
in whidi hypertext documents may be created automatically. 

If a user desires to print a hypertext document, a hardcopy 
of the displayed document may be printed. However, the 
printed version does not contain the hypertext information. 
That is. the link information associated with tfie document is 
lost. Furthermore, because the link infOTmatioD is lost it is 
impossible to use the printed copy of the document to 
recreate the hypertext document i one desires to reaeate 
the hypertext document the user must again specify both 
active regions and tficir link inforroation. It is desirable to 
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automate the process to allow a hypertext document to be 
printed out and then, using that printout, recreate a hypertext 
document without having to actively interact in the set up of 
the hypertext document 

^ The present invention provides for conversion between 
hardcopy (e.g.. {^ain text) and hypertext documents. In the 
present invention, this conversion is performed automati- 
cally. Furthermore, the present invention allows a hardcopy 
version of the hypertext document to be created, such that 

10 the link information remains with the hardcopy version. In 
this manner, the hardcopy document may be used to recreate 
a hypertext version of the document with the con'ect. or 
same, link information. 



The present invention provides a method and apparatus 
for generating clectrooic documents from a hardcopy 
document and vice versa. A hardcopy document contains 
encoded link information and one or more regions dcsig- 
^ nated to be active that are associated with the encoding link 
information. The hardcopy document is scanned and the 
scanned information is converted into an electronic version 
of the hardcopy document having active regions. Each 
active region is linked to electronic information, sudi that 
selection of an active region accesses linked electronic 
information. 

BRIEF DESCMFnON OF THE DRAWINGS 

The present invention will be understood more fully from 
^ the detailed description given below and from the accom- 
panying drawings of various embodiments of the invention, 
which, however, should not be taken to limit the invention 
to the specific embodiments, but arc for explanation and 
understanding only. 

FIG. 1 illustrates an example of a hardcopy document 
containing encoded link infoimation. 

FIG. 2 is a flow diagram of one embodiment of die 
hardcopy to hypertext document conversion process of the 
4Q present invention. 

FIG. 3 is a block diagram of an exemi^ary computer 
system that may be enq}loyed by the present invention to 
convert hardcopy versions of documents to electronic ver- 
sions of documents and vice versa. 
45 FIG. 4 is one embodiment of Worid Wide Web document 
retrieval and publishing system of the present invention. 

FIG. 5 is a flow diagram of one embodiment of the 
hypertext version to hardcopy version conversion process of 
the present invention. 
^ FIG. 6A is an image of a sanqsle hypertext document. 

FIG. 6B is a magnified portion of the hypertext repre- 
sented in FIG. 6A. 

FIG. 6C illustrates the hypcrwords being detected through 
the use of a template. 

FIG. is a magnified view of one emtxxiimcnt of a 
template for locating the hypcrwords in a hypertext docu- 
ment 

FIG. 6E illustrates a set of correlation values that result 
60 from applying the ten^late of RG. 6D throughout the 
hypertext document at the boxed region as shown In FIG. 
6C. 

DETAILED DESCRHTlON OF THE PRESENT 
^ INVENTION 

A method and apparatus for converting between a bypa- 
text and plain text document is described. In the following 
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detailed descriptioa of (he present invention Duxnerous spe- 
cific details are set forth, such as number of pages of 
documents, types of encoding, numbers of links, etc., in 
order to provide a thorough understanding of the present 
invention. However, it will be apparent to one skilled in ttie 5 
art that the present invention may be practiced without these 
specific details. In ottier instances, well-known structures 
and devices are shown in blodc diagram fom:i, rather than b 
detail, in order to avoid obscuring the present invention. 

Some portions of the detailed descriptions which follow 10 
are presented in terms of algorithms and symbolic repre- 
sentations of operations on data bits within a computer 
memory. These algorithmic descriptions and rq^rcsentations 
are the means used by those skilled in the data processing 
arts to most effectively convey the substance of their work 15 
to others skilled in the art. An algorithm is here, and 
genaally, conceived to be a sclf-<x)nsistcnt sequence of steps 
leading to a desired result The stq)s are those requiring, 
physical manipulations of physical quantities. Usually, 
though not necessarily, these quantities take the form of 20 
electrical or magnetic signals enable of being stored, 
transferred, combined, compared, and otherwise manipu- 
lated. It has proven convenient at times, principally for 
reasons of common usage, to refer to these signals as bits, 
values, elements, symbols, characters, terms, numbers, or 25 
the like. 

It should bt borne in mind, however, that all of these and 
similar terms are to be associated with the appropriate 
physical quantities and are merely convenient labels ^pUed 
to these quantities. Unless specifically stated otherwise as 30 
i^>parent from the following discussions, it is af^eciated 
that throughout the present invention, discussions utilizing 
terms such as **iffooessing*' or "computing*" or ^'calculating** 
or "determining" or "displaying" or the like, refer to the 
action and processes of a computer system, or similar 35 
electronic computing device, ttiat manipulates and trans> 
forms data represented as physical (electronic) quantities 
within the con^uter system* s registers and memories into 
other data similarly r^esented as i^y&ical quantities within 
the con^uter system memories or registers or other such 4o 
information storage, transmission or display devices. 

The present invention also relates to apparatus for per- 
fonning the operations herein* This apparatus may be spe- 
cially constructed for the required purposes, or it may 
comprise a general purpose computer selectively activated 
or reconfigured by a computer program stored in the com- 
puter. The algorithms and displays presented herein are not 
inherently related to any particular computer or odier appa- 
ratus. Various general purpose machines noay be used with 
programs in accordance with the teachings herein, or it may ^ 
prove convenient to construct more spcciaLized apparatus to 
perform the required method steps. The required structure 
for a variety of these machines will appear from the descrip- 
tion below. In addition, the present invention is not 
described with reference to any particular programming ^3 
language. It will be q>preciated that a variety of program- 
ming languages may be used to implement the teachings o( 
the invention as described herein. 

Overview of the ftesent Invention 

60 

The present invention provides for converting a hardcopy 
version of a document containing, for instance, text and/or 
graphical features such asfigures.'intoan-ej ec^nic version 
of die document. In one embodiment* a paper document is 
convertcd'into an electronic document and vice versa 65 

One plication of the present invention is to convert 
paper documents into hypertext document The paper docu- 
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ment includes hypertext words and gr^>hical features as 
well as encoded link information. By decoding the encoded 
link information and determining the location of active or 
"clickable** regions in the document an electronic version of 
the document may be aeated. 

For example, in the [^scnt invention, die user may take 
a hardcopy document containing, for example, ten pages of 
multi-column text, tables, and gr^hics containing "high- 
lighted words", in-tcxt references and a sidechannel of 
encoded information. The ''highlighted'' portions symbolize 
active regions that are designated to be active in the docu- 
inent The user scans these pages into a document conver- 
sion system to form a full electronic hypertext version of the 
doauitcnt automatically, having "clickable" links within the 
document that may link to other portions of die document as 
well as to a data base of documents, possibly via Mosaic. 

The present invention also provides for printing a full 
electronic (e.g.. hypertext) version of a dociunent ttiat is in 
a system into one or more pages of a hardcopy document 
such as paper. filrOi or other similar medium containing text 
tables, highli^ted words and graphical features, in-text 
references and a sidechannel of encoded information. This 
printed document then may be inserted into the document 
conversion system of the present invention to recreate the 
electronic (e.g., hypertext) version of the document Thus, 
an electronic version of a document on a computer system 
may be printed to create a hardcopy version. coiiq>lete with 
encoded information to enable the reaeatlon of the elec- 
tronic version. 

Plain Text to Hypertext Conversion Process 

The plain text to hypertext conversion process of the 
present invention is performed on a hardcopy (e.g., papa- 
document). An exemplary paper page of the document is 
shown in FIG. 1. Referring to FIG. 1. the page is shown with 
text 102 on the right side containing text, key words, and 
graphical features such as figures. A section of encoded data 
101 on the hardcopy^dociiment oont§ins4nf6cmatio^ 
ciatedl^ffi3Seiey..WOTd£;^g^ etc. and rtieir h^efflnks, 
In-o(hefwords, the encoded information 101 contains hyper- 
link information that is used in the document to actively 
renicve other portions of the document or other doctmients. 

In one embodiment, the encoded information 101 com- 
prises machine readable information. The machine readable 
information may be a digital format such as a barcode or 
digital paper, one embodiment of which is described in U.S. 
Pat No. 5 J37J62, entiUed "Mediod and Apparatus for 
Placing DaU Onto Plain Paper**, issued on Aug. 9. 1994. and 
assigned to the corporate assignee of the present invention. 
Other types of encoding may be used in the present inven- 
tion as long as identification and selection of links and their 
association with the "hypertext" (or active regions) in the 
text are possible. 

In one embodiment the encoded information may be 
encrypted using one of the well-known encryption 
techniques, such as public/private key. RSA, etc. 

The encoded madiine-readable information 101 may be 
located anywhere on the document where human-readable 
information is not obscured (This location is referred to as 
a side channel). In one embodiment the encoded informa- 
tion 101 is located at the left-handed side of each page. Note 
that in this case, it is the responsibility of the recognition 
hardware and/or software in a computer system to locate and 
identify the machine readable information in order to obtain 
(he hyperlink information contained therein. 

As shown in FIG. 1, the encoded information is contained 
in a boxed region. The encoded information 101 may be 
contained In one or more (e.g., 2. 3, 4. etc.) t>oxes. 
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The infonnatioD contained in the encoded infckrmation 
101 is associated with key woids and figures and their 
byperlinks. In one enibodiment. the encoded information 
101 for text may identify the location of the key words in the 
text portion and its associated link information specifying 
the document (or portion thereof) that is to t>e retrieved upon 
selection of the active region. In one embodiment, the key 
word is actually included in the encoded information. In 
such case it would be the responsibility of the coDversion 
system to locate that key word in the text, via scardi, to 
associate its hyperlink information. In another embodiment 
the encoded infonnation 101 may not contain the key word, 
but instead contain its location. Its location may be spediled 
by the location of the start of a key word or may be in the 
form of a bounding box which identifies an area in the text 
portion containing the key word assodaied with a particular 
hypalink. As for figures, the infonnation for a particular 
figure may only need to encode the rough position of the 
figure, since a segmentation algorithm, as described later, 
will locate its true boundaries. Likewise, the code used for 
a particular word may not specify the precise (x,y) position 
of the target word. Instead, encoding merely the line number 
or the order of the key word may suf&cc while another 
algorithm is used to identify the correct word. Note, the key 
word noay be located based on the manner in which it is 
highlighted (e.g.. underlining, bold, different color, etc.) in 
the hardcopy document. In anotha embodiment, the 
encoded data might contain links (the actual path 
information) to audio or movie files, if not just text or 
graphics. 

RG. 2 illustrates Ae process of converting a hardcopy 
document, such as a plain text docunoenU to an electronic 
document such as a hypertext document. The process of 
plain text to hypertext document conversion begins by 
scanning a document having one or more pages (processing 
block 201). In one embodiment each of the pages may 
resemble the page shown in FIG. 1. A scanner may t)e used 
to perfcm the function with the resulting output being, for 
cxan^e. a bit map image. 

The bit map image is segmented to separate and locate 
features such as figures, paragraphs, lines, words, letters, and 
tables from the encoded information ([Hocessing block 202). 
In one embodiment the segmentation algorithm may divide 
the bit map image based on knowledge of where the encoded 
infoimatiott is on the page. For instance, a segmentation 
algorithm may assume that the encoded information is 
always located on the left side of each page at a specific 
location. 

In one embodiment the sidechannel infomuition is stored 
in a box or rectangular shaped area wherein the border may 
be a certain number of pixels thick. In such a case, the 
segmcnution algorithm performs a search for a border by 
scanning a row until a predetermined number of black pixels 
are founid in a row. In one embodiment, a border may be 
three pixels diick. Once the box has been located, the 
information contained therein may be decoded. This decod- 
ing may be performed in a manner similar to diat described 
in U.S. Pat No. 5 J37362, eniiaed '*Method and ji^jparatus 
for Placing Data Onto Plain Paper'*, issued Aug. 9. 1994. and 
assigned to the corporate assignee of the present invention. 

Once the location of the encoded link infonnation has 
been identified, the machine readable information is recog- 
nized and decoded to determine the hypertext link informa- 
tion contained therein (processing block 203). 

Next, the *1iighllghted'* regions (Le., regions designated to 
be active) are identified (processing block 2i4). In one 
embodiment, the encoded lnf<vmation indicates the location 
of each active region. Thai is. active words or other elements 
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may be identified by specific information setting forth the 
location and size (e.g.. specifying a bounding box within 
which the word or object exists) in the madUne readable 
information in the sidechannel. In an alternate embodiment 

, the identification of these active regions is made using one 
or more templates. The template may represent the form of 
hlg^ghting used to set off the wchxI or figure in the plain 
text The template may be a bitmapped version of the 
highlighting. For instance, alternating black and white 
dashes may be used to underline each of the key words. In 

10 the present invention, an algorithm uses a bit mapped 
version of the alternating bkck and white dashes as a 
template to search the plain text until a strong coirclatioD or 
perfect match occurs between the template and infonnation 
in the text portion. If there is a con-elation between die 
template and die area being checked that is above a specified 
threshold, then it is determined that hypertext link ix wcrd 
exists. The ten^late(s) may be specified in the encoded 
sidechannel information or may be selected by the recogni- 
tion algorithm. Note that the use of thresholds is well-known 
in the art Further, the thresholds may be set by a system 

20 designer and^or user. 

It should be noted that recognition of the digital informa- 
tion may be performed after identifying specific gr^hical 
features, paragr^hs. lines, words, leners, tables in the text 
portion of die scanned hardcopy document 

25 Once the encoded information has been decoded and 
specific active regions in the plain text portion of the 
document identified, the hyperlink information is associated 
with the active words and/or objects (processing block 205). 
and processing is performed to create the hypertext docu- 
ment in a manner well-known in the art such that the 
selection of one of the marked words causes that portion of 
the document or other documents to be retrieved biased on a 
resource locator within the link information. 

Note that when creating the hypertext document image to 
be displayable on screen, the active regions (e.g., the key 
words or objects) associated with hyperlink infonnation may 
be highlighted in any manner. The manner of highlighting 
may be specified by die processing procedure creating the 
hypertext document The highlighting may be underlining or 
placing the active portions of a document in a cfifferent font 

^ or color (e.g.. bold). It should be noted that die highlighting 
selected for the newly created hypertext document does not 
have to be the same form of highlighting used to designate 
the active regions in the hardcopy vcrsicm of the document 
FIG. 3 illustrates an overview of one embodiment of the 

45 document conversion system of the present Invention shown 
in block diagram form. The system of the present invention 
is a digital processing system. It will t>e understood that 
while FIG. 3 is useful for providing an overall description of 
the processing system of die present invention, a number of 

50 details of die system are not shown. As necessary for 
disclosure of the present invention, further detail is set forth 
with other figures provided with this specification. Further, 
the present invention is described with reference to various 
embodiment; alternative embodiments which may be con- 
ceived by one of ordinary skill in the art are considered 
within die scope of die claims set forth below. 

Referring to RG. 3. die system of die present invention 
includes a bus or other communication means 301 for 
communicating information. Processor 302 is coupled with 
bus 301 for processing information. A random access 

® memory (RAM) or other dynamic storage device 303 
(conunonly referred to as a main memory) for storing 
information and instructions for processor 302 is also 
coupled to bus 301. Also coupled to bus 302 is a read only 
memory (ROM) or other static storage device 304 for 

^ storing static information and instructions for processor 302 
and a data storage device 305. sudt as a magnetic disk and 
disk drive for storing information and instructions. 
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'^L^f'T^''^^. /y^*"™ ^ ^ P^^"^- '"^^ could »>c paformcd usine location 

coupled to bus 301 for scanning selected hardcopy versions infoimadon specified in die machine readable i^omiation 

of documents into tfjc system. Scanner 306 is capable of (encoded portion) of the bit map image of the plain paper 

reading digital represenUtions of images (e.g.. digital document or using a template ^dfied in the decoded 

papa), as weU as regular images. 5 machine readable infonnation or defined in storage and 

In one embodiment, scanner 306 comprises a gray scale ^fways used by the conversion software. Hiird. the conver- 

scanner. In one embodiment, the resolution <rf scanner 306 swn software translates the link information and the recog- 
rcsolution is 200 DPI Scanner 306 converts the individual regions into a hypertext document. Note 

picture elements, referred to as pixels, of (he scanned imace \r P^^^^^ ^ch of these conversion step is 

into digital values. In one embodiment seamier 306 com- '^^^ m the art 

prises an Image Scanner ICS-400 brand scanner of Ricoh . embodiment, the computer system is coupled via 

CwporaUon of West CaldweU, N.J. In odicr embodiments, ^^ r^J^^^!^^^^^^ mechanism to a Web site in the 

scanner 306 is a bit map scanner which scans the image of world wide Web (WWW), Such a connection is iUustrated 

each hardcopy input document in a predetermined spatial *° . ^' ^ embodinacnt the cotxxputci system may 

resolution to produce digital values. These digital values ^<>"Vnse the Web site and the Web site is coupled to the 

collectively produce a data structure known as a bil man ^^^^ o*cr network cx document resource which 

image, which is weU-known to tfiose in the irt provides access to the WWW. 

Note that in one embodiment ^occssor 302 runs one or n..wfch J ^^P^* ^ 

more software routines to perfonn die segmentation, d^od- ^""^^^"^ ""'^ ^ ^^^^^^ ^"^^ that 

ing and electronic document creation processes for a docu- „ ^'""^rl ^^^^ ^^""^^ (hyperwords) on an electronic 
mcnt conversion system using the input from scanner 306. ^ °f ^^cumtui being displayed causes the retrieval 

Thus, in one embodiment processor 302 operates as the ?«^nts portions of die document 

encoder and the decoder of the present invention. The ^"^^ ^ « universal resource locator or other 

software may be stored and accessed from a memory in die ^^^^^^ lOcntmcr. 

system. Note also diat processor 302 may also peiform should be noted that die present invention is not limited 

encryption and decryption if enQ>loyed in die document 25 Jo «^«v^ng and publishing documents on die WWW or die 

conversion process. Internet. The teachings of die present invention may be 
The computer system may include separate decoder hard- "networks, data document storage and 

ware and eicod/hardware distinct fi^S^s^^X k ^''^ '^'^ client/service systems 

A ^ A r« . proccsscar ^^ich have documents or odier information available upon 

A hardcopy device 307 is also coupled to bus 301 for request ^ 

^I^^J^Z"^ ^T.''''f''''' f documents Aat were con- ^ iTie present invention includes a process by which a 
r^fJ^^ 't^'?^ ^ ^'"^^^^ h^<*- hypertext document is converted into 7aZ ^ 
cc^y device 307 could compose a p otter or printer, such as ment One embodiment of diis process is sTwVrFIGS 
a bit map printer diat maps the digital values of a bit map n^e hardcopy document that reS^s <^^s 

SS^'^"^^"'^^^^^^^^^ 3. ^^<>r^f -chine rea^^ 

oijittiai uisuu. 35 mjjj J hypertext document fonuu. Thus, the link 

Moreover, a human or user inteifaee 3«8 is included for Motmatioii wiU be available to the user to enable a reversal 

enabhng a user to interact with processor 3«2. scanner 306 back into a hypciteait documcnL 

^™1"^°^^H^-^ "^^i^"^"'"' *° "G. 5. the conversion process begins by 

r "^"^ 7^ crcatingaWtraapof ahypapagcthatisoDicnUy dSiycd 

control instiucttons to and receives feedback from the pho- 40 on the di!i)lay saeen from a screen "diimp" fnrocessine 

(J.e.. processor 302. scanner 3W and hardcopy block 5*1). /i example of such a ixS instownk 

aey ce jvjy piG j^. a portion of the bit map Is shown in HG. €B. 

Use» interface 3M could ipdude an alphanumeric input Once a bit map has been created, die present invention 

device ududing alphanumeric and other keys for commu- detects the hj^pafwcrds in the bit map (SSng Mock 

nicattng inforrnation and command selections, a cursor 43 502). In one embodiment the hypowcrds are detected by 

conttol device for controUmg cursa movement and/or a using a tcn^late. Such a template is shown in FIG. 6D. TTie 

dispby device, such as a cathode ray lube (CUT), liquid present invention searches the bit map locating portions of 

crystal display^^ etc. for displaying information to the pho- the bit map with the template, generating condalton values 

ocopier user. Note that these coniponcnts are weU-known in fIQ. SB illustrates corelation values around the boxed 

2«Sl^^Ji i„t^",r??^/*iKT'*'"°°'''^°''^^^ « «gion shown in HO. «C. Hie coSon vSuf taS 
mg ttie present invenUon. Note that w one embodiment, user whedier ttiere is a hioh cftrrpiarinn k*.k«**« ^^ZH^Z^ZT 

lnterface30«mayprovidelnp«sdirectly toscanner306a«d S^nt fte t^ST^ '° P-*^'^ 
\^y^^^'^^^^<^^^f->'-^^^'^ OncethemarkedZdshavebeenide„.ilxed..helocaUon 
v„,„ ,1,., tt,^' ^ , . . ^ hyperlink information is encoded (processing block 

Note that these components may be mtegrated together 503). the information is formatted into oie or moil pa^s 
into a smgle systein^ separately accessible components. " (processing block 504). and a haixJcopy document is irtn^ 
r""" ^^^r^^'^ device 307. In one {f^Wng a sidediannel with en«>d^^yS^M«Sn 
«»d/«>r hardcopy device 307 could (processing block SOS). In one embodiSa7e^U^; 
be coupled 10 bus 301 using dedicated communication links be encoded as weU for use in locating active rSr 

or switcfaaMe communication networks. an.^.... '"^iuub rcgioos. 

In nn,. ,mh~ij,«.», «. • ■ . fo "^V altoations and modifications of the 

to one embo<ta«nt. the processor 302. m conjunction « present invention will no doubt become apparent to a person 
T*^*ff sUU In the art after having read the forgoing 

software that performs die foUowmg flinctions. First, the description, it is to be understood that the particular cnAodi- 
convffsion software decodes the machine readable informa- ment shown and desoibed by way of illustration are in no 
tion that is encoded m the sidechannel to obtain link infor- way to be considered limiting. Therefore, referent to the 
S,°«t*'„i?f,^„'** ! WgUifhted. or active, 65 details of the various embodiments are not intended to limit 

w«ds or objects in the text porUoa Second, the conversion the scope of the claims which Uiemselves recite onlv those 
software recognl2es words or active regions in the text featureTregarded as essential totoe invention 
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Thus, a method and apparatus for cx)nvcituig between 
hardcopy versions and electronic versions of documents has 
been described. 

We claim: 

1. A method of converting a hardcopy document to an 
electronic document comprising the steps of: 

scanning a hardcopy document containing encoded link 
information and one or more regions designated to be 
active associated with said encoded link information; 

decoding the encoded link information to obtain the link 
information associated with said one or more regions; 

locating said one or more regions in a scanned-in version 
of the hardcopy document, wherein the stq> of locating 
comprises searching a bit map of the scanned hardcopy 
document using a tenqilate stared in the encoded link 
information and obtained when decoding die encoded 
link information; and 

creating an electronic version of the hardcopy document 
having said one or more regions linked to electronic 
information, such that selection of any of said one a- 
more regions accesses linked electrooic information. 

2. The method defined in daim 1 wherein (he encoded 
link information identifies a location of at least one of said 
one or more regions in the document 

3. The method defined in claim 1 wherein the encoded 
link information includes location information identifying a 
location of said at least one of said one or more regions in 
the document 

4. A method of generating an electronic document com- 
prising the steps of: 

scanning a hardcopy document containing encoded link 
information and one or more regions designated to be 
active associated with said encoded link information; 
and 

converting scanned information to an electronic version 
of the hardcopy document having active regions, 
wherein the step of converting comprises 
decoding the encoded link information, 
determining a location of each of said active regions, 
and 

linidng each active region to electronic inf Grmation via 
decoded link information* such that selection of an 
active region accesses linked electronic information, 
and 

wherein the encoded link information includes location 
information identifying a location of at least one of said 
active regions in the document and further wherein the 
location information identifies at least one word located 
in a text portion of the hardcopy document associated 
with said at least one active region. 

5. The method defined in claim 4 wherein the location 
Information identifies a start of a word associated with said 
at least one active region. 

6. The method defined in claim 4 wherein the scanned 
information Is converted a hypertext version of the paper 
document having hypertext links one word located in a text 
portion of the hardcopy document associated with. 

7. The method defined in claim 6 wherein the location 
information Identifies a start of a word associated with said 
at least one active region. 

8. A method of generating an electronic document com- 
prising the steps of: 

scanning a hardcc^y document containing encoded link 
information and one or more regions designated to be 
active associated with said encoded link information; 
and 

converting scanned information to an electronic version 
of the hardcopy document having active regions, 
wherein the step of converting comprises 
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decoding the encoded link information, 
determining a location of each of said active regions, 
and 

linking each active region to electronic information via 
decoded link infcmadon. such that selection of an 
active region accesses linked electronic information, 
and 

wherein the encoded link information includes location 
informaticm identifying a location of at least one of said 
active regions in the document, and further wherein the 
location information indicates a bounding box speci- 
fying an area containing said at least one active region. 

9. The method defined in claim 8 wherein the scanned 
information is converted a hypertext version of the paper 
document having hypertext links. 

10. A method of generating an electronic document com- 
prising die steps of: 

scanning a hardcopy document containing encoded link 
information and one or more regions designated to be 
active associated with said encoded link information; 
and 

converting scanned information to an eledrotiic version 
of the hardcopy document having active regions, 
wherein the step of converting comprises 
decoding die encoded link information* 
determining a location of each of said active regions, 
and 

linking each active region to electronic information via 
decoded link Loformation, such that selection of an 
active region accesses linked 
wherein the encoded link information includes location 
information identifying a location of at least one of said 
active regions in the document and further wherein the 
locadon information indicates a Line number and order 
location associated with said at least one active region. 

11. The method defined in claim 8 wherein the scanned 
information is converted a hypertext version of the paper 
document having hypertext links. 

12. A method cf generating an electronic document com- 
prising the steps of: 

scanning a hardcopy document containing encoded link 
infomoation and one or more regions designated to be 
active associated with said encoded link information; 
and 

converting scanned information to an electronic version 
of the hardcopy document having active regions, 
wherein the step of converting comprises 
decoding the encoded link information, 
determining a location of each of said active regions, 
and 

linki ng each active region to electronic information via 
decoded link information, such that selection of an 
active region accesses linked electronic information, 
and 

wherein the encoded link information sets forth at least 
one of said active regions located in the document and 
the manner in which said at least one active region is 
highlighted. 

13. Hie method defined in claim 12 wherein the encoded 
link information identifies a location of said at least one of 
said active regions in the document. 

14. The mediod defined in claim 12 wherein the encoded 
linic infoimatjon includes location information identifying a 
location of said at least one of said active regi^ms in the 
document 

15. The noethod defined in claim 12 wherein the scanned 
information is converted a hypertext version of die paper 
document having hypertext links. 
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16. A method of generating an electronic document com- 
piising the steps of: 

scanning a hardcopy document containing encoded link 
Infonoation and one or more regions designated to be 
active associated with said encoded linJc information; 5 
and 

converting scanned infonnatioD to an electronic version 

of the hardcopy document having active regions. 

wherein the stq> of converting comprises 

decoding the encoded link information. 

determining a location of each of said active regions, 
wherein the step of determining a location of each of 
said active regions comprises searching a bit map of 
the scanned hardcopy document using a template 
that is stored in the encoded linic information and 
obtained when decoding the encoded link 
information, and 

linking each active region to electronic infonnation via 
decoded link information, such that selection of an 
active region accesses linked electronic information, 

17. The mediod defined in claim 16 wherein the scanned 
information is converted a hypertext version of the paper 
document having hypertext links. 

18. A system for converting a hardcopy version of a 
document to an electronic version comprising: 25 

a scanner to scan the hardcopy version of the document; 

a decoder coi^led to the scanner to decode encoded link 
information in scanned informatioD from the scanner, 
wherein the encoded link information includes location 
information identifying a location of at least one active ^ 
region in the document, and further wherein the loca- 
tion information identifies at least one word located in 
a text portion of the hardcopy document associated 
wilh said at least one active region; and 

processing logic coupled to the scanner and die decoder to 
identify and locate active regions designated to be 
linked to other eiectrooic information indicated in the 
encoded link information and to create the electronic 
version in which selection of one of said active regions ^ 
when said electronic version is displayed causes the 
linked information associated with said one of said 
active regions to be retrieved. 

19. The apparatus defined in claim 18 wherein the loca- 
tion information identifies a start of a word associated with 
said at least one active region. 

20. A system for converting a hardcopy version of a 
document to an electronic version corx^irisiiig: 

a scanner to scan the hardcopy version of the document; 

a decoder coupled to the scanner to decode encoded link 50 
information in scanned information from the scanner, 
wherein the encoded link informatioa includes location 
information identiiying a location of at least one active 
region in the document, and further wherein die loca- 
tion information indicates a bounding box speciiying 
an area containing said at least one active region; and 

processing logic coupled to the scanner and the decoder to 
identify and locate active regions designated to be 
linked to other electronic information indicated in the 
encoded link information and to aeate the electronic 60 
version in which selection of one of said active regions 
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when said electronic version is displayed causes the 
linked information associated with said one of said 
active regions to be retrieved. 

21. A system for converting a hardcopy version of a 
document to an electronic version comprising: 

a scanner to scan the hardcopy version of the document; 

a decoder coupled to the scanner to decode encoded link 
information in scanned information from the scanner, 
wherein the encoded link information includes location 
information identiiying a location of at least one active 
region in die document, and further wherein (he loca- 
tion information indicates a line number and order 
location associated with said at least one active region; 
and 

processing logic coujrfcd to the scanner and the decoder to 
identify and locate active regions designated to be 
linked to odicr electronic information indicated in the 
encoded link information and to create the electronic 
version in which sclcctioD of one of said active regions 
when said electronic version is displayed causes the 
linked infcHination associated with said one of said 
active regions to be retrieved. 

22. A system for converting a hardcopy version of a 
document to an electronic version comprising: 

a scanner to scan the hardcopy version of the document; 

a decoder coupled to the scanner to decode encoded link 
information in scanned information from the scanner, 
wherein the encoded link information sets forth at least 
one of said active regions located in the document and 
the manner in which said at least one active region is 
highlighted; and 

processing logic coupled to the scanner and die decoder to 
identify and locate active regions designated to be 
linked to other electronic information indicated in the 
encoded link infarmation and to create the electronic 
version in which selection of one of said active regions 
when said electronic version is displayed causes the 
linked information associated with said one of said 
active regions to be retrieved, 

23. A system for converting a hardcopy version of a 
dociunent to an electronic version comprising: 

a scanner to scan the hardcopy version of the document; 
a decoder coupled to the scanner to decode encoded link 

information in scanned information from the scanner; 

and 

processing logic coupled to die scanner and tf)e decoder to 
identify and locate regions designated to be linked to 
other electronic information indicated in the encoded 
link information and to create the electronic version in 
which selection of one of said regions when said 
electronic version is displayed causes the linked infer- 
mation associated with said one of said regions to be 
retrieved, and wherein the processing logic searches a 
bit map of the scanned hardcopy document using a 
template that Is stored in the encoded link information 
and obtained when decoding the encoded Link infar- 
mation. 

***** 
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